00:00:00.001 Started by upstream project "autotest-per-patch" build number 121284 00:00:00.001 originally caused by: 00:00:00.001 Started by user sys_sgci 00:00:00.108 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.108 The recommended git tool is: git 00:00:00.109 using credential 00000000-0000-0000-0000-000000000002 00:00:00.110 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.144 Fetching changes from the remote Git repository 00:00:00.146 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.193 Using shallow fetch with depth 1 00:00:00.193 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.193 > git --version # timeout=10 00:00:00.214 > git --version # 'git version 2.39.2' 00:00:00.214 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.215 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.215 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.155 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.166 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.178 Checking out Revision f964f6d3463483adf05cc5c086f2abd292e05f1d (FETCH_HEAD) 00:00:06.178 > git config core.sparsecheckout # timeout=10 00:00:06.189 > git read-tree -mu HEAD # timeout=10 00:00:06.207 > git checkout -f f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=5 00:00:06.228 Commit message: "ansible/roles/custom_facts: Drop nvme features" 00:00:06.228 > git rev-list --no-walk f964f6d3463483adf05cc5c086f2abd292e05f1d # timeout=10 00:00:06.305 [Pipeline] Start of Pipeline 00:00:06.317 [Pipeline] library 00:00:06.318 Loading library shm_lib@master 00:00:06.318 Library shm_lib@master is cached. Copying from home. 00:00:06.338 [Pipeline] node 00:00:06.368 Running on WFP34 in /var/jenkins/workspace/nvmf-phy-autotest 00:00:06.369 [Pipeline] { 00:00:06.381 [Pipeline] catchError 00:00:06.383 [Pipeline] { 00:00:06.396 [Pipeline] wrap 00:00:06.404 [Pipeline] { 00:00:06.414 [Pipeline] stage 00:00:06.417 [Pipeline] { (Prologue) 00:00:06.655 [Pipeline] sh 00:00:06.940 + logger -p user.info -t JENKINS-CI 00:00:06.958 [Pipeline] echo 00:00:06.959 Node: WFP34 00:00:06.969 [Pipeline] sh 00:00:07.268 [Pipeline] setCustomBuildProperty 00:00:07.279 [Pipeline] echo 00:00:07.280 Cleanup processes 00:00:07.284 [Pipeline] sh 00:00:07.562 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.562 723098 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.575 [Pipeline] sh 00:00:07.856 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:07.856 ++ grep -v 'sudo pgrep' 00:00:07.856 ++ awk '{print $1}' 00:00:07.856 + sudo kill -9 00:00:07.856 + true 00:00:07.871 [Pipeline] cleanWs 00:00:07.880 [WS-CLEANUP] Deleting project workspace... 00:00:07.880 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.887 [WS-CLEANUP] done 00:00:07.893 [Pipeline] setCustomBuildProperty 00:00:07.911 [Pipeline] sh 00:00:08.188 + sudo git config --global --replace-all safe.directory '*' 00:00:08.252 [Pipeline] nodesByLabel 00:00:08.253 Found a total of 1 nodes with the 'sorcerer' label 00:00:08.264 [Pipeline] httpRequest 00:00:08.272 HttpMethod: GET 00:00:08.273 URL: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.276 Sending request to url: http://10.211.164.96/packages/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:08.285 Response Code: HTTP/1.1 200 OK 00:00:08.286 Success: Status code 200 is in the accepted range: 200,404 00:00:08.286 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:10.054 [Pipeline] sh 00:00:10.338 + tar --no-same-owner -xf jbp_f964f6d3463483adf05cc5c086f2abd292e05f1d.tar.gz 00:00:10.356 [Pipeline] httpRequest 00:00:10.360 HttpMethod: GET 00:00:10.361 URL: http://10.211.164.96/packages/spdk_c1efd80ca5201517fd299a045c6010b5aa224b11.tar.gz 00:00:10.361 Sending request to url: http://10.211.164.96/packages/spdk_c1efd80ca5201517fd299a045c6010b5aa224b11.tar.gz 00:00:10.372 Response Code: HTTP/1.1 200 OK 00:00:10.373 Success: Status code 200 is in the accepted range: 200,404 00:00:10.374 Saving response body to /var/jenkins/workspace/nvmf-phy-autotest/spdk_c1efd80ca5201517fd299a045c6010b5aa224b11.tar.gz 00:00:40.858 [Pipeline] sh 00:00:41.147 + tar --no-same-owner -xf spdk_c1efd80ca5201517fd299a045c6010b5aa224b11.tar.gz 00:00:43.732 [Pipeline] sh 00:00:44.011 + git -C spdk log --oneline -n5 00:00:44.012 c1efd80ca lib/idxd: use bit array to track WQ use 00:00:44.012 28e549c03 lib/idxd: refactor IDXD wq config common parts 00:00:44.012 f06ac750c lib/idxd: refactor to alloc and dealloc single batch 00:00:44.012 13a9f2aa2 lib/idxd: deallocate batches on channel creation failure 00:00:44.012 1eae9e764 lib/idxd: simplify early failure in _dsa_alloc_batches 00:00:44.023 [Pipeline] } 00:00:44.040 [Pipeline] // stage 00:00:44.048 [Pipeline] stage 00:00:44.050 [Pipeline] { (Prepare) 00:00:44.070 [Pipeline] writeFile 00:00:44.090 [Pipeline] sh 00:00:44.374 + logger -p user.info -t JENKINS-CI 00:00:44.386 [Pipeline] sh 00:00:44.668 + logger -p user.info -t JENKINS-CI 00:00:44.682 [Pipeline] sh 00:00:44.964 + cat autorun-spdk.conf 00:00:44.964 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:44.964 SPDK_TEST_NVMF=1 00:00:44.964 SPDK_TEST_NVME_CLI=1 00:00:44.964 SPDK_TEST_NVMF_NICS=mlx5 00:00:44.964 SPDK_RUN_UBSAN=1 00:00:44.964 NET_TYPE=phy 00:00:44.971 RUN_NIGHTLY=0 00:00:44.975 [Pipeline] readFile 00:00:44.997 [Pipeline] withEnv 00:00:44.999 [Pipeline] { 00:00:45.012 [Pipeline] sh 00:00:45.297 + set -ex 00:00:45.297 + [[ -f /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf ]] 00:00:45.297 + source /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:45.297 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:45.297 ++ SPDK_TEST_NVMF=1 00:00:45.297 ++ SPDK_TEST_NVME_CLI=1 00:00:45.297 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:45.297 ++ SPDK_RUN_UBSAN=1 00:00:45.297 ++ NET_TYPE=phy 00:00:45.297 ++ RUN_NIGHTLY=0 00:00:45.297 + case $SPDK_TEST_NVMF_NICS in 00:00:45.297 + DRIVERS=mlx5_ib 00:00:45.297 + [[ -n mlx5_ib ]] 00:00:45.297 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:45.297 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:51.864 rmmod: ERROR: Module irdma is not currently loaded 00:00:51.864 rmmod: ERROR: Module i40iw is not currently loaded 00:00:51.864 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:51.864 + true 00:00:51.864 + for D in $DRIVERS 00:00:51.864 + sudo modprobe mlx5_ib 00:00:51.864 + exit 0 00:00:51.873 [Pipeline] } 00:00:51.892 [Pipeline] // withEnv 00:00:51.897 [Pipeline] } 00:00:51.912 [Pipeline] // stage 00:00:51.922 [Pipeline] catchError 00:00:51.924 [Pipeline] { 00:00:51.938 [Pipeline] timeout 00:00:51.938 Timeout set to expire in 40 min 00:00:51.940 [Pipeline] { 00:00:51.955 [Pipeline] stage 00:00:51.956 [Pipeline] { (Tests) 00:00:51.973 [Pipeline] sh 00:00:52.258 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-phy-autotest 00:00:52.258 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest 00:00:52.258 + DIR_ROOT=/var/jenkins/workspace/nvmf-phy-autotest 00:00:52.258 + [[ -n /var/jenkins/workspace/nvmf-phy-autotest ]] 00:00:52.258 + DIR_SPDK=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:52.258 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-phy-autotest/output 00:00:52.258 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/spdk ]] 00:00:52.258 + [[ ! -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:52.258 + mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/output 00:00:52.258 + [[ -d /var/jenkins/workspace/nvmf-phy-autotest/output ]] 00:00:52.258 + cd /var/jenkins/workspace/nvmf-phy-autotest 00:00:52.258 + source /etc/os-release 00:00:52.258 ++ NAME='Fedora Linux' 00:00:52.258 ++ VERSION='38 (Cloud Edition)' 00:00:52.258 ++ ID=fedora 00:00:52.258 ++ VERSION_ID=38 00:00:52.258 ++ VERSION_CODENAME= 00:00:52.258 ++ PLATFORM_ID=platform:f38 00:00:52.258 ++ PRETTY_NAME='Fedora Linux 38 (Cloud Edition)' 00:00:52.258 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:52.258 ++ LOGO=fedora-logo-icon 00:00:52.258 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:38 00:00:52.258 ++ HOME_URL=https://fedoraproject.org/ 00:00:52.258 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f38/system-administrators-guide/ 00:00:52.258 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:52.258 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:52.258 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:52.258 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=38 00:00:52.258 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:52.258 ++ REDHAT_SUPPORT_PRODUCT_VERSION=38 00:00:52.258 ++ SUPPORT_END=2024-05-14 00:00:52.258 ++ VARIANT='Cloud Edition' 00:00:52.258 ++ VARIANT_ID=cloud 00:00:52.258 + uname -a 00:00:52.258 Linux spdk-wfp-34 6.7.0-68.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Jan 15 00:59:40 UTC 2024 x86_64 GNU/Linux 00:00:52.259 + sudo /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:00:55.547 Hugepages 00:00:55.547 node hugesize free / total 00:00:55.547 node0 1048576kB 0 / 0 00:00:55.547 node0 2048kB 0 / 0 00:00:55.547 node1 1048576kB 0 / 0 00:00:55.547 node1 2048kB 0 / 0 00:00:55.547 00:00:55.547 Type BDF Vendor Device NUMA Driver Device Block devices 00:00:55.547 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:00:55.547 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:00:55.547 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:00:55.547 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:00:55.547 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:00:55.547 + rm -f /tmp/spdk-ld-path 00:00:55.548 + source autorun-spdk.conf 00:00:55.548 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:55.548 ++ SPDK_TEST_NVMF=1 00:00:55.548 ++ SPDK_TEST_NVME_CLI=1 00:00:55.548 ++ SPDK_TEST_NVMF_NICS=mlx5 00:00:55.548 ++ SPDK_RUN_UBSAN=1 00:00:55.548 ++ NET_TYPE=phy 00:00:55.548 ++ RUN_NIGHTLY=0 00:00:55.548 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:00:55.548 + [[ -n '' ]] 00:00:55.548 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:55.548 + for M in /var/spdk/build-*-manifest.txt 00:00:55.548 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:00:55.548 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:55.548 + for M in /var/spdk/build-*-manifest.txt 00:00:55.548 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:00:55.548 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-phy-autotest/output/ 00:00:55.548 ++ uname 00:00:55.548 + [[ Linux == \L\i\n\u\x ]] 00:00:55.548 + sudo dmesg -T 00:00:55.548 + sudo dmesg --clear 00:00:55.548 + dmesg_pid=723969 00:00:55.548 + [[ Fedora Linux == FreeBSD ]] 00:00:55.548 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:55.548 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:00:55.548 + sudo dmesg -Tw 00:00:55.548 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:00:55.548 + [[ -x /usr/src/fio-static/fio ]] 00:00:55.548 + export FIO_BIN=/usr/src/fio-static/fio 00:00:55.548 + FIO_BIN=/usr/src/fio-static/fio 00:00:55.548 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:00:55.548 + [[ ! -v VFIO_QEMU_BIN ]] 00:00:55.548 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:00:55.548 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:55.548 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:00:55.548 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:00:55.548 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:55.548 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:00:55.548 + spdk/autorun.sh /var/jenkins/workspace/nvmf-phy-autotest/autorun-spdk.conf 00:00:55.548 Test configuration: 00:00:55.548 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:55.548 SPDK_TEST_NVMF=1 00:00:55.548 SPDK_TEST_NVME_CLI=1 00:00:55.548 SPDK_TEST_NVMF_NICS=mlx5 00:00:55.548 SPDK_RUN_UBSAN=1 00:00:55.548 NET_TYPE=phy 00:00:55.548 RUN_NIGHTLY=0 17:49:04 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:00:55.548 17:49:04 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:00:55.548 17:49:04 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:00:55.548 17:49:04 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:00:55.548 17:49:04 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:55.548 17:49:04 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:55.548 17:49:04 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:55.548 17:49:04 -- paths/export.sh@5 -- $ export PATH 00:00:55.548 17:49:04 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:00:55.548 17:49:04 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:00:55.548 17:49:04 -- common/autobuild_common.sh@435 -- $ date +%s 00:00:55.548 17:49:04 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714146544.XXXXXX 00:00:55.548 17:49:04 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714146544.GwHzR8 00:00:55.548 17:49:04 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:00:55.548 17:49:04 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:00:55.548 17:49:04 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:00:55.548 17:49:04 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:00:55.548 17:49:04 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:00:55.548 17:49:04 -- common/autobuild_common.sh@451 -- $ get_config_params 00:00:55.548 17:49:04 -- common/autotest_common.sh@395 -- $ xtrace_disable 00:00:55.548 17:49:04 -- common/autotest_common.sh@10 -- $ set +x 00:00:55.548 17:49:04 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:00:55.548 17:49:04 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:00:55.548 17:49:04 -- pm/common@17 -- $ local monitor 00:00:55.548 17:49:04 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:55.548 17:49:04 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=724003 00:00:55.548 17:49:04 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:55.548 17:49:04 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=724005 00:00:55.548 17:49:04 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:55.548 17:49:04 -- pm/common@21 -- $ date +%s 00:00:55.548 17:49:04 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=724007 00:00:55.548 17:49:04 -- pm/common@21 -- $ date +%s 00:00:55.548 17:49:04 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:00:55.548 17:49:04 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=724010 00:00:55.548 17:49:04 -- pm/common@26 -- $ sleep 1 00:00:55.548 17:49:04 -- pm/common@21 -- $ date +%s 00:00:55.548 17:49:04 -- pm/common@21 -- $ date +%s 00:00:55.548 17:49:04 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714146544 00:00:55.548 17:49:04 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714146544 00:00:55.548 17:49:04 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714146544 00:00:55.548 17:49:04 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autobuild.sh.1714146544 00:00:55.548 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714146544_collect-vmstat.pm.log 00:00:55.548 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714146544_collect-cpu-temp.pm.log 00:00:55.548 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714146544_collect-bmc-pm.bmc.pm.log 00:00:55.548 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autobuild.sh.1714146544_collect-cpu-load.pm.log 00:00:56.484 17:49:05 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:00:56.484 17:49:05 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:00:56.484 17:49:05 -- spdk/autobuild.sh@12 -- $ umask 022 00:00:56.484 17:49:05 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:00:56.484 17:49:05 -- spdk/autobuild.sh@16 -- $ date -u 00:00:56.484 Fri Apr 26 03:49:05 PM UTC 2024 00:00:56.484 17:49:05 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:00:56.484 v24.05-pre-456-gc1efd80ca 00:00:56.484 17:49:05 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:00:56.484 17:49:05 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:00:56.484 17:49:05 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:00:56.484 17:49:05 -- common/autotest_common.sh@1097 -- $ '[' 3 -le 1 ']' 00:00:56.484 17:49:05 -- common/autotest_common.sh@1103 -- $ xtrace_disable 00:00:56.484 17:49:05 -- common/autotest_common.sh@10 -- $ set +x 00:00:56.743 ************************************ 00:00:56.743 START TEST ubsan 00:00:56.743 ************************************ 00:00:56.743 17:49:05 -- common/autotest_common.sh@1121 -- $ echo 'using ubsan' 00:00:56.743 using ubsan 00:00:56.743 00:00:56.743 real 0m0.001s 00:00:56.743 user 0m0.000s 00:00:56.743 sys 0m0.000s 00:00:56.743 17:49:05 -- common/autotest_common.sh@1122 -- $ xtrace_disable 00:00:56.743 17:49:05 -- common/autotest_common.sh@10 -- $ set +x 00:00:56.743 ************************************ 00:00:56.743 END TEST ubsan 00:00:56.743 ************************************ 00:00:56.743 17:49:05 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:00:56.743 17:49:05 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:00:56.744 17:49:05 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:00:56.744 17:49:05 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:00:56.744 Using default SPDK env in /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:00:56.744 Using default DPDK in /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:00:57.001 Using 'verbs' RDMA provider 00:01:10.141 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal.log)...done. 00:01:25.077 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-phy-autotest/spdk/.spdk-isal-crypto.log)...done. 00:01:25.077 Creating mk/config.mk...done. 00:01:25.077 Creating mk/cc.flags.mk...done. 00:01:25.077 Type 'make' to build. 00:01:25.077 17:49:32 -- spdk/autobuild.sh@69 -- $ run_test make make -j72 00:01:25.077 17:49:32 -- common/autotest_common.sh@1097 -- $ '[' 3 -le 1 ']' 00:01:25.077 17:49:32 -- common/autotest_common.sh@1103 -- $ xtrace_disable 00:01:25.077 17:49:32 -- common/autotest_common.sh@10 -- $ set +x 00:01:25.077 ************************************ 00:01:25.077 START TEST make 00:01:25.077 ************************************ 00:01:25.077 17:49:32 -- common/autotest_common.sh@1121 -- $ make -j72 00:01:25.077 make[1]: Nothing to be done for 'all'. 00:01:33.206 The Meson build system 00:01:33.206 Version: 1.3.1 00:01:33.206 Source dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk 00:01:33.206 Build dir: /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp 00:01:33.206 Build type: native build 00:01:33.206 Program cat found: YES (/usr/bin/cat) 00:01:33.206 Project name: DPDK 00:01:33.206 Project version: 23.11.0 00:01:33.206 C compiler for the host machine: cc (gcc 13.2.1 "cc (GCC) 13.2.1 20231011 (Red Hat 13.2.1-4)") 00:01:33.206 C linker for the host machine: cc ld.bfd 2.39-16 00:01:33.206 Host machine cpu family: x86_64 00:01:33.206 Host machine cpu: x86_64 00:01:33.206 Message: ## Building in Developer Mode ## 00:01:33.206 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:33.206 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:33.206 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:33.206 Program python3 found: YES (/usr/bin/python3) 00:01:33.206 Program cat found: YES (/usr/bin/cat) 00:01:33.206 Compiler for C supports arguments -march=native: YES 00:01:33.206 Checking for size of "void *" : 8 00:01:33.206 Checking for size of "void *" : 8 (cached) 00:01:33.206 Library m found: YES 00:01:33.206 Library numa found: YES 00:01:33.206 Has header "numaif.h" : YES 00:01:33.206 Library fdt found: NO 00:01:33.206 Library execinfo found: NO 00:01:33.206 Has header "execinfo.h" : YES 00:01:33.206 Found pkg-config: YES (/usr/bin/pkg-config) 1.8.0 00:01:33.206 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:33.206 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:33.206 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:33.206 Run-time dependency openssl found: YES 3.0.9 00:01:33.206 Run-time dependency libpcap found: YES 1.10.4 00:01:33.206 Has header "pcap.h" with dependency libpcap: YES 00:01:33.206 Compiler for C supports arguments -Wcast-qual: YES 00:01:33.206 Compiler for C supports arguments -Wdeprecated: YES 00:01:33.206 Compiler for C supports arguments -Wformat: YES 00:01:33.206 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:33.206 Compiler for C supports arguments -Wformat-security: NO 00:01:33.206 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:33.206 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:33.206 Compiler for C supports arguments -Wnested-externs: YES 00:01:33.206 Compiler for C supports arguments -Wold-style-definition: YES 00:01:33.206 Compiler for C supports arguments -Wpointer-arith: YES 00:01:33.206 Compiler for C supports arguments -Wsign-compare: YES 00:01:33.206 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:33.206 Compiler for C supports arguments -Wundef: YES 00:01:33.206 Compiler for C supports arguments -Wwrite-strings: YES 00:01:33.206 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:33.206 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:33.206 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:33.206 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:33.206 Program objdump found: YES (/usr/bin/objdump) 00:01:33.206 Compiler for C supports arguments -mavx512f: YES 00:01:33.206 Checking if "AVX512 checking" compiles: YES 00:01:33.206 Fetching value of define "__SSE4_2__" : 1 00:01:33.206 Fetching value of define "__AES__" : 1 00:01:33.206 Fetching value of define "__AVX__" : 1 00:01:33.206 Fetching value of define "__AVX2__" : 1 00:01:33.206 Fetching value of define "__AVX512BW__" : 1 00:01:33.206 Fetching value of define "__AVX512CD__" : 1 00:01:33.206 Fetching value of define "__AVX512DQ__" : 1 00:01:33.206 Fetching value of define "__AVX512F__" : 1 00:01:33.206 Fetching value of define "__AVX512VL__" : 1 00:01:33.206 Fetching value of define "__PCLMUL__" : 1 00:01:33.206 Fetching value of define "__RDRND__" : 1 00:01:33.206 Fetching value of define "__RDSEED__" : 1 00:01:33.206 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:33.206 Fetching value of define "__znver1__" : (undefined) 00:01:33.206 Fetching value of define "__znver2__" : (undefined) 00:01:33.206 Fetching value of define "__znver3__" : (undefined) 00:01:33.206 Fetching value of define "__znver4__" : (undefined) 00:01:33.206 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:33.206 Message: lib/log: Defining dependency "log" 00:01:33.206 Message: lib/kvargs: Defining dependency "kvargs" 00:01:33.206 Message: lib/telemetry: Defining dependency "telemetry" 00:01:33.206 Checking for function "getentropy" : NO 00:01:33.206 Message: lib/eal: Defining dependency "eal" 00:01:33.206 Message: lib/ring: Defining dependency "ring" 00:01:33.206 Message: lib/rcu: Defining dependency "rcu" 00:01:33.206 Message: lib/mempool: Defining dependency "mempool" 00:01:33.206 Message: lib/mbuf: Defining dependency "mbuf" 00:01:33.206 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:33.206 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:33.206 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:33.206 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:33.206 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:33.206 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:33.206 Compiler for C supports arguments -mpclmul: YES 00:01:33.206 Compiler for C supports arguments -maes: YES 00:01:33.206 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:33.206 Compiler for C supports arguments -mavx512bw: YES 00:01:33.206 Compiler for C supports arguments -mavx512dq: YES 00:01:33.206 Compiler for C supports arguments -mavx512vl: YES 00:01:33.206 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:33.206 Compiler for C supports arguments -mavx2: YES 00:01:33.206 Compiler for C supports arguments -mavx: YES 00:01:33.206 Message: lib/net: Defining dependency "net" 00:01:33.206 Message: lib/meter: Defining dependency "meter" 00:01:33.206 Message: lib/ethdev: Defining dependency "ethdev" 00:01:33.206 Message: lib/pci: Defining dependency "pci" 00:01:33.206 Message: lib/cmdline: Defining dependency "cmdline" 00:01:33.206 Message: lib/hash: Defining dependency "hash" 00:01:33.206 Message: lib/timer: Defining dependency "timer" 00:01:33.206 Message: lib/compressdev: Defining dependency "compressdev" 00:01:33.206 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:33.206 Message: lib/dmadev: Defining dependency "dmadev" 00:01:33.206 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:33.206 Message: lib/power: Defining dependency "power" 00:01:33.206 Message: lib/reorder: Defining dependency "reorder" 00:01:33.206 Message: lib/security: Defining dependency "security" 00:01:33.206 Has header "linux/userfaultfd.h" : YES 00:01:33.206 Has header "linux/vduse.h" : YES 00:01:33.206 Message: lib/vhost: Defining dependency "vhost" 00:01:33.207 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:33.207 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:33.207 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:33.207 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:33.207 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:33.207 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:33.207 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:33.207 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:33.207 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:33.207 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:33.207 Program doxygen found: YES (/usr/bin/doxygen) 00:01:33.207 Configuring doxy-api-html.conf using configuration 00:01:33.207 Configuring doxy-api-man.conf using configuration 00:01:33.207 Program mandb found: YES (/usr/bin/mandb) 00:01:33.207 Program sphinx-build found: NO 00:01:33.207 Configuring rte_build_config.h using configuration 00:01:33.207 Message: 00:01:33.207 ================= 00:01:33.207 Applications Enabled 00:01:33.207 ================= 00:01:33.207 00:01:33.207 apps: 00:01:33.207 00:01:33.207 00:01:33.207 Message: 00:01:33.207 ================= 00:01:33.207 Libraries Enabled 00:01:33.207 ================= 00:01:33.207 00:01:33.207 libs: 00:01:33.207 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:33.207 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:33.207 cryptodev, dmadev, power, reorder, security, vhost, 00:01:33.207 00:01:33.207 Message: 00:01:33.207 =============== 00:01:33.207 Drivers Enabled 00:01:33.207 =============== 00:01:33.207 00:01:33.207 common: 00:01:33.207 00:01:33.207 bus: 00:01:33.207 pci, vdev, 00:01:33.207 mempool: 00:01:33.207 ring, 00:01:33.207 dma: 00:01:33.207 00:01:33.207 net: 00:01:33.207 00:01:33.207 crypto: 00:01:33.207 00:01:33.207 compress: 00:01:33.207 00:01:33.207 vdpa: 00:01:33.207 00:01:33.207 00:01:33.207 Message: 00:01:33.207 ================= 00:01:33.207 Content Skipped 00:01:33.207 ================= 00:01:33.207 00:01:33.207 apps: 00:01:33.207 dumpcap: explicitly disabled via build config 00:01:33.207 graph: explicitly disabled via build config 00:01:33.207 pdump: explicitly disabled via build config 00:01:33.207 proc-info: explicitly disabled via build config 00:01:33.207 test-acl: explicitly disabled via build config 00:01:33.207 test-bbdev: explicitly disabled via build config 00:01:33.207 test-cmdline: explicitly disabled via build config 00:01:33.207 test-compress-perf: explicitly disabled via build config 00:01:33.207 test-crypto-perf: explicitly disabled via build config 00:01:33.207 test-dma-perf: explicitly disabled via build config 00:01:33.207 test-eventdev: explicitly disabled via build config 00:01:33.207 test-fib: explicitly disabled via build config 00:01:33.207 test-flow-perf: explicitly disabled via build config 00:01:33.207 test-gpudev: explicitly disabled via build config 00:01:33.207 test-mldev: explicitly disabled via build config 00:01:33.207 test-pipeline: explicitly disabled via build config 00:01:33.207 test-pmd: explicitly disabled via build config 00:01:33.207 test-regex: explicitly disabled via build config 00:01:33.207 test-sad: explicitly disabled via build config 00:01:33.207 test-security-perf: explicitly disabled via build config 00:01:33.207 00:01:33.207 libs: 00:01:33.207 metrics: explicitly disabled via build config 00:01:33.207 acl: explicitly disabled via build config 00:01:33.207 bbdev: explicitly disabled via build config 00:01:33.207 bitratestats: explicitly disabled via build config 00:01:33.207 bpf: explicitly disabled via build config 00:01:33.207 cfgfile: explicitly disabled via build config 00:01:33.207 distributor: explicitly disabled via build config 00:01:33.207 efd: explicitly disabled via build config 00:01:33.207 eventdev: explicitly disabled via build config 00:01:33.207 dispatcher: explicitly disabled via build config 00:01:33.207 gpudev: explicitly disabled via build config 00:01:33.207 gro: explicitly disabled via build config 00:01:33.207 gso: explicitly disabled via build config 00:01:33.207 ip_frag: explicitly disabled via build config 00:01:33.207 jobstats: explicitly disabled via build config 00:01:33.207 latencystats: explicitly disabled via build config 00:01:33.207 lpm: explicitly disabled via build config 00:01:33.207 member: explicitly disabled via build config 00:01:33.207 pcapng: explicitly disabled via build config 00:01:33.207 rawdev: explicitly disabled via build config 00:01:33.207 regexdev: explicitly disabled via build config 00:01:33.207 mldev: explicitly disabled via build config 00:01:33.207 rib: explicitly disabled via build config 00:01:33.207 sched: explicitly disabled via build config 00:01:33.207 stack: explicitly disabled via build config 00:01:33.207 ipsec: explicitly disabled via build config 00:01:33.207 pdcp: explicitly disabled via build config 00:01:33.207 fib: explicitly disabled via build config 00:01:33.207 port: explicitly disabled via build config 00:01:33.207 pdump: explicitly disabled via build config 00:01:33.207 table: explicitly disabled via build config 00:01:33.207 pipeline: explicitly disabled via build config 00:01:33.207 graph: explicitly disabled via build config 00:01:33.207 node: explicitly disabled via build config 00:01:33.207 00:01:33.207 drivers: 00:01:33.207 common/cpt: not in enabled drivers build config 00:01:33.207 common/dpaax: not in enabled drivers build config 00:01:33.207 common/iavf: not in enabled drivers build config 00:01:33.207 common/idpf: not in enabled drivers build config 00:01:33.207 common/mvep: not in enabled drivers build config 00:01:33.207 common/octeontx: not in enabled drivers build config 00:01:33.207 bus/auxiliary: not in enabled drivers build config 00:01:33.207 bus/cdx: not in enabled drivers build config 00:01:33.207 bus/dpaa: not in enabled drivers build config 00:01:33.207 bus/fslmc: not in enabled drivers build config 00:01:33.207 bus/ifpga: not in enabled drivers build config 00:01:33.207 bus/platform: not in enabled drivers build config 00:01:33.207 bus/vmbus: not in enabled drivers build config 00:01:33.207 common/cnxk: not in enabled drivers build config 00:01:33.207 common/mlx5: not in enabled drivers build config 00:01:33.207 common/nfp: not in enabled drivers build config 00:01:33.207 common/qat: not in enabled drivers build config 00:01:33.207 common/sfc_efx: not in enabled drivers build config 00:01:33.207 mempool/bucket: not in enabled drivers build config 00:01:33.207 mempool/cnxk: not in enabled drivers build config 00:01:33.207 mempool/dpaa: not in enabled drivers build config 00:01:33.207 mempool/dpaa2: not in enabled drivers build config 00:01:33.207 mempool/octeontx: not in enabled drivers build config 00:01:33.207 mempool/stack: not in enabled drivers build config 00:01:33.207 dma/cnxk: not in enabled drivers build config 00:01:33.207 dma/dpaa: not in enabled drivers build config 00:01:33.207 dma/dpaa2: not in enabled drivers build config 00:01:33.207 dma/hisilicon: not in enabled drivers build config 00:01:33.207 dma/idxd: not in enabled drivers build config 00:01:33.207 dma/ioat: not in enabled drivers build config 00:01:33.207 dma/skeleton: not in enabled drivers build config 00:01:33.207 net/af_packet: not in enabled drivers build config 00:01:33.207 net/af_xdp: not in enabled drivers build config 00:01:33.207 net/ark: not in enabled drivers build config 00:01:33.207 net/atlantic: not in enabled drivers build config 00:01:33.207 net/avp: not in enabled drivers build config 00:01:33.207 net/axgbe: not in enabled drivers build config 00:01:33.207 net/bnx2x: not in enabled drivers build config 00:01:33.207 net/bnxt: not in enabled drivers build config 00:01:33.207 net/bonding: not in enabled drivers build config 00:01:33.207 net/cnxk: not in enabled drivers build config 00:01:33.207 net/cpfl: not in enabled drivers build config 00:01:33.207 net/cxgbe: not in enabled drivers build config 00:01:33.207 net/dpaa: not in enabled drivers build config 00:01:33.207 net/dpaa2: not in enabled drivers build config 00:01:33.207 net/e1000: not in enabled drivers build config 00:01:33.207 net/ena: not in enabled drivers build config 00:01:33.207 net/enetc: not in enabled drivers build config 00:01:33.207 net/enetfec: not in enabled drivers build config 00:01:33.207 net/enic: not in enabled drivers build config 00:01:33.207 net/failsafe: not in enabled drivers build config 00:01:33.207 net/fm10k: not in enabled drivers build config 00:01:33.207 net/gve: not in enabled drivers build config 00:01:33.207 net/hinic: not in enabled drivers build config 00:01:33.207 net/hns3: not in enabled drivers build config 00:01:33.207 net/i40e: not in enabled drivers build config 00:01:33.207 net/iavf: not in enabled drivers build config 00:01:33.207 net/ice: not in enabled drivers build config 00:01:33.207 net/idpf: not in enabled drivers build config 00:01:33.207 net/igc: not in enabled drivers build config 00:01:33.207 net/ionic: not in enabled drivers build config 00:01:33.207 net/ipn3ke: not in enabled drivers build config 00:01:33.207 net/ixgbe: not in enabled drivers build config 00:01:33.207 net/mana: not in enabled drivers build config 00:01:33.207 net/memif: not in enabled drivers build config 00:01:33.207 net/mlx4: not in enabled drivers build config 00:01:33.207 net/mlx5: not in enabled drivers build config 00:01:33.207 net/mvneta: not in enabled drivers build config 00:01:33.207 net/mvpp2: not in enabled drivers build config 00:01:33.207 net/netvsc: not in enabled drivers build config 00:01:33.207 net/nfb: not in enabled drivers build config 00:01:33.207 net/nfp: not in enabled drivers build config 00:01:33.207 net/ngbe: not in enabled drivers build config 00:01:33.207 net/null: not in enabled drivers build config 00:01:33.207 net/octeontx: not in enabled drivers build config 00:01:33.207 net/octeon_ep: not in enabled drivers build config 00:01:33.207 net/pcap: not in enabled drivers build config 00:01:33.207 net/pfe: not in enabled drivers build config 00:01:33.207 net/qede: not in enabled drivers build config 00:01:33.207 net/ring: not in enabled drivers build config 00:01:33.207 net/sfc: not in enabled drivers build config 00:01:33.207 net/softnic: not in enabled drivers build config 00:01:33.207 net/tap: not in enabled drivers build config 00:01:33.207 net/thunderx: not in enabled drivers build config 00:01:33.207 net/txgbe: not in enabled drivers build config 00:01:33.208 net/vdev_netvsc: not in enabled drivers build config 00:01:33.208 net/vhost: not in enabled drivers build config 00:01:33.208 net/virtio: not in enabled drivers build config 00:01:33.208 net/vmxnet3: not in enabled drivers build config 00:01:33.208 raw/*: missing internal dependency, "rawdev" 00:01:33.208 crypto/armv8: not in enabled drivers build config 00:01:33.208 crypto/bcmfs: not in enabled drivers build config 00:01:33.208 crypto/caam_jr: not in enabled drivers build config 00:01:33.208 crypto/ccp: not in enabled drivers build config 00:01:33.208 crypto/cnxk: not in enabled drivers build config 00:01:33.208 crypto/dpaa_sec: not in enabled drivers build config 00:01:33.208 crypto/dpaa2_sec: not in enabled drivers build config 00:01:33.208 crypto/ipsec_mb: not in enabled drivers build config 00:01:33.208 crypto/mlx5: not in enabled drivers build config 00:01:33.208 crypto/mvsam: not in enabled drivers build config 00:01:33.208 crypto/nitrox: not in enabled drivers build config 00:01:33.208 crypto/null: not in enabled drivers build config 00:01:33.208 crypto/octeontx: not in enabled drivers build config 00:01:33.208 crypto/openssl: not in enabled drivers build config 00:01:33.208 crypto/scheduler: not in enabled drivers build config 00:01:33.208 crypto/uadk: not in enabled drivers build config 00:01:33.208 crypto/virtio: not in enabled drivers build config 00:01:33.208 compress/isal: not in enabled drivers build config 00:01:33.208 compress/mlx5: not in enabled drivers build config 00:01:33.208 compress/octeontx: not in enabled drivers build config 00:01:33.208 compress/zlib: not in enabled drivers build config 00:01:33.208 regex/*: missing internal dependency, "regexdev" 00:01:33.208 ml/*: missing internal dependency, "mldev" 00:01:33.208 vdpa/ifc: not in enabled drivers build config 00:01:33.208 vdpa/mlx5: not in enabled drivers build config 00:01:33.208 vdpa/nfp: not in enabled drivers build config 00:01:33.208 vdpa/sfc: not in enabled drivers build config 00:01:33.208 event/*: missing internal dependency, "eventdev" 00:01:33.208 baseband/*: missing internal dependency, "bbdev" 00:01:33.208 gpu/*: missing internal dependency, "gpudev" 00:01:33.208 00:01:33.208 00:01:33.208 Build targets in project: 85 00:01:33.208 00:01:33.208 DPDK 23.11.0 00:01:33.208 00:01:33.208 User defined options 00:01:33.208 buildtype : debug 00:01:33.208 default_library : shared 00:01:33.208 libdir : lib 00:01:33.208 prefix : /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:01:33.208 c_args : -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds -fPIC -Werror 00:01:33.208 c_link_args : 00:01:33.208 cpu_instruction_set: native 00:01:33.208 disable_apps : test-acl,test-bbdev,test-crypto-perf,test-fib,test-pipeline,test-gpudev,test-flow-perf,pdump,dumpcap,test-sad,test-cmdline,test-eventdev,proc-info,test,test-dma-perf,test-pmd,test-mldev,test-compress-perf,test-security-perf,graph,test-regex 00:01:33.208 disable_libs : pipeline,member,eventdev,efd,bbdev,cfgfile,rib,sched,mldev,metrics,lpm,latencystats,pdump,pdcp,bpf,ipsec,fib,ip_frag,table,port,stack,gro,jobstats,regexdev,rawdev,pcapng,dispatcher,node,bitratestats,acl,gpudev,distributor,graph,gso 00:01:33.208 enable_docs : false 00:01:33.208 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:33.208 enable_kmods : false 00:01:33.208 tests : false 00:01:33.208 00:01:33.208 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:33.208 ninja: Entering directory `/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp' 00:01:33.208 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:33.208 [2/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:33.208 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:33.208 [4/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:33.208 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:33.208 [6/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:33.208 [7/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:33.208 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:33.208 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:33.208 [10/265] Linking static target lib/librte_kvargs.a 00:01:33.208 [11/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:33.208 [12/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:33.208 [13/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:33.208 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:33.208 [15/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:33.208 [16/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:33.208 [17/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:33.208 [18/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:33.208 [19/265] Linking static target lib/librte_log.a 00:01:33.208 [20/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:33.208 [21/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:33.208 [22/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:33.208 [23/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:33.208 [24/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:33.208 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:33.468 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:33.730 [27/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:33.730 [28/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:33.730 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:33.730 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:33.730 [31/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:33.730 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:33.730 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:33.730 [34/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:33.730 [35/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:33.730 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:33.730 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:33.730 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:33.730 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:33.730 [40/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:33.730 [41/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:33.730 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:33.730 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:33.730 [44/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:33.730 [45/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:33.730 [46/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:33.730 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:33.730 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:33.730 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:33.730 [50/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:33.730 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:33.730 [52/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:33.730 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:33.730 [54/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:33.730 [55/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:33.730 [56/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:33.730 [57/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:33.730 [58/265] Linking static target lib/librte_ring.a 00:01:33.730 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:33.730 [60/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:33.730 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:33.730 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:33.730 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:33.730 [64/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.730 [65/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:33.730 [66/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:33.730 [67/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:33.730 [68/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:33.730 [69/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:33.730 [70/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:33.730 [71/265] Linking static target lib/librte_telemetry.a 00:01:33.730 [72/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:33.730 [73/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:33.730 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:33.730 [75/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:33.730 [76/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:33.730 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:33.730 [78/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:33.730 [79/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:33.730 [80/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:33.730 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:33.730 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:33.730 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:33.730 [84/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:33.730 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:33.730 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:33.730 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:33.730 [88/265] Linking static target lib/librte_pci.a 00:01:33.730 [89/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:33.730 [90/265] Linking static target lib/librte_meter.a 00:01:33.730 [91/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:33.730 [92/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:33.730 [93/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:33.730 [94/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:33.730 [95/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:33.730 [96/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:33.730 [97/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:33.991 [98/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:33.991 [99/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:33.991 [100/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:33.991 [101/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:33.992 [102/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:33.992 [103/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:33.992 [104/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:33.992 [105/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:33.992 [106/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:33.992 [107/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:33.992 [108/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:33.992 [109/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:33.992 [110/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:33.992 [111/265] Linking static target lib/librte_rcu.a 00:01:33.992 [112/265] Linking static target lib/librte_mempool.a 00:01:33.992 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:33.992 [114/265] Linking static target lib/librte_net.a 00:01:33.992 [115/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:33.992 [116/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:33.992 [117/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:33.992 [118/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:33.992 [119/265] Linking static target lib/librte_eal.a 00:01:33.992 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:33.992 [121/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [122/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [123/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [124/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [125/265] Linking target lib/librte_log.so.24.0 00:01:34.251 [126/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:34.251 [127/265] Linking static target lib/librte_mbuf.a 00:01:34.251 [128/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:34.251 [129/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:34.251 [130/265] Linking static target lib/librte_cmdline.a 00:01:34.251 [131/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:34.251 [132/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:34.251 [133/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:34.251 [134/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:34.251 [135/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:34.251 [137/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:34.251 [138/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:34.251 [139/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [140/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:34.251 [141/265] Linking static target lib/librte_timer.a 00:01:34.251 [142/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:34.251 [143/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:34.251 [144/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:34.251 [145/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.251 [146/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:34.251 [147/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:34.251 [148/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:34.251 [149/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:34.251 [150/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:34.251 [151/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:34.251 [152/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:34.251 [153/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:34.509 [154/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:34.509 [155/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:34.509 [156/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:34.509 [157/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:34.509 [158/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:34.509 [159/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:34.509 [160/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:34.509 [161/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:34.509 [162/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:34.509 [163/265] Linking static target lib/librte_compressdev.a 00:01:34.509 [164/265] Linking static target lib/librte_dmadev.a 00:01:34.509 [165/265] Linking target lib/librte_telemetry.so.24.0 00:01:34.509 [166/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:34.509 [167/265] Linking target lib/librte_kvargs.so.24.0 00:01:34.509 [168/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:34.509 [169/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:34.509 [170/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:34.509 [171/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:34.509 [172/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:34.509 [173/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:34.509 [174/265] Linking static target lib/librte_reorder.a 00:01:34.509 [175/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:34.509 [176/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:34.509 [177/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:34.509 [178/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:34.509 [179/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:34.509 [180/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:34.509 [181/265] Linking static target lib/librte_power.a 00:01:34.509 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:34.509 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:34.509 [184/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:34.509 [185/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:34.509 [186/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:34.509 [187/265] Linking static target lib/librte_security.a 00:01:34.509 [188/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:34.509 [189/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:34.509 [190/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:34.509 [191/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:34.509 [192/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:34.509 [193/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:34.509 [194/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:34.767 [195/265] Linking static target lib/librte_hash.a 00:01:34.767 [196/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:34.767 [197/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:34.767 [198/265] Linking static target drivers/librte_bus_vdev.a 00:01:34.767 [199/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:34.767 [200/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.767 [201/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.767 [202/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:34.767 [203/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:34.767 [204/265] Linking static target drivers/librte_bus_pci.a 00:01:34.767 [205/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:34.767 [206/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:34.767 [207/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:34.767 [208/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:34.767 [209/265] Linking static target drivers/librte_mempool_ring.a 00:01:34.767 [210/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:34.767 [211/265] Linking static target lib/librte_cryptodev.a 00:01:34.767 [212/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.025 [213/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.025 [214/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.025 [215/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.025 [216/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.283 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.283 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:35.283 [219/265] Linking static target lib/librte_ethdev.a 00:01:35.283 [220/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:35.541 [221/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.541 [222/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.541 [223/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.541 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.477 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:36.477 [226/265] Linking static target lib/librte_vhost.a 00:01:37.067 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.443 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.997 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.930 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.930 [231/265] Linking target lib/librte_eal.so.24.0 00:01:45.930 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:46.188 [233/265] Linking target lib/librte_ring.so.24.0 00:01:46.188 [234/265] Linking target lib/librte_meter.so.24.0 00:01:46.188 [235/265] Linking target lib/librte_timer.so.24.0 00:01:46.188 [236/265] Linking target lib/librte_pci.so.24.0 00:01:46.188 [237/265] Linking target lib/librte_dmadev.so.24.0 00:01:46.188 [238/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:46.188 [239/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:46.188 [240/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:46.188 [241/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:46.188 [242/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:46.188 [243/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:46.188 [244/265] Linking target lib/librte_mempool.so.24.0 00:01:46.188 [245/265] Linking target lib/librte_rcu.so.24.0 00:01:46.188 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:46.446 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:46.446 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:46.446 [249/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:46.447 [250/265] Linking target lib/librte_mbuf.so.24.0 00:01:46.447 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:46.705 [252/265] Linking target lib/librte_compressdev.so.24.0 00:01:46.705 [253/265] Linking target lib/librte_cryptodev.so.24.0 00:01:46.705 [254/265] Linking target lib/librte_reorder.so.24.0 00:01:46.705 [255/265] Linking target lib/librte_net.so.24.0 00:01:46.705 [256/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:46.705 [257/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:46.705 [258/265] Linking target lib/librte_security.so.24.0 00:01:46.705 [259/265] Linking target lib/librte_cmdline.so.24.0 00:01:46.705 [260/265] Linking target lib/librte_hash.so.24.0 00:01:46.705 [261/265] Linking target lib/librte_ethdev.so.24.0 00:01:46.963 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:46.963 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:46.963 [264/265] Linking target lib/librte_power.so.24.0 00:01:46.963 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:46.963 INFO: autodetecting backend as ninja 00:01:46.963 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build-tmp -j 72 00:01:48.339 CC lib/ut/ut.o 00:01:48.339 CC lib/log/log.o 00:01:48.339 CC lib/log/log_flags.o 00:01:48.339 CC lib/ut_mock/mock.o 00:01:48.339 CC lib/log/log_deprecated.o 00:01:48.339 LIB libspdk_ut.a 00:01:48.339 SO libspdk_ut.so.2.0 00:01:48.339 LIB libspdk_ut_mock.a 00:01:48.339 LIB libspdk_log.a 00:01:48.339 SO libspdk_ut_mock.so.6.0 00:01:48.339 SYMLINK libspdk_ut.so 00:01:48.339 SO libspdk_log.so.7.0 00:01:48.339 SYMLINK libspdk_ut_mock.so 00:01:48.339 SYMLINK libspdk_log.so 00:01:48.905 CC lib/ioat/ioat.o 00:01:48.905 CC lib/dma/dma.o 00:01:48.905 CC lib/util/bit_array.o 00:01:48.905 CC lib/util/base64.o 00:01:48.905 CC lib/util/cpuset.o 00:01:48.905 CC lib/util/crc16.o 00:01:48.905 CC lib/util/crc32.o 00:01:48.905 CC lib/util/crc32c.o 00:01:48.905 CC lib/util/crc32_ieee.o 00:01:48.905 CXX lib/trace_parser/trace.o 00:01:48.905 CC lib/util/crc64.o 00:01:48.905 CC lib/util/dif.o 00:01:48.905 CC lib/util/file.o 00:01:48.905 CC lib/util/fd.o 00:01:48.905 CC lib/util/math.o 00:01:48.905 CC lib/util/hexlify.o 00:01:48.905 CC lib/util/iov.o 00:01:48.905 CC lib/util/strerror_tls.o 00:01:48.905 CC lib/util/pipe.o 00:01:48.905 CC lib/util/string.o 00:01:48.905 CC lib/util/uuid.o 00:01:48.905 CC lib/util/fd_group.o 00:01:48.905 CC lib/util/xor.o 00:01:48.905 CC lib/util/zipf.o 00:01:48.905 CC lib/vfio_user/host/vfio_user_pci.o 00:01:48.905 CC lib/vfio_user/host/vfio_user.o 00:01:48.905 LIB libspdk_dma.a 00:01:48.905 SO libspdk_dma.so.4.0 00:01:48.905 LIB libspdk_ioat.a 00:01:49.163 SO libspdk_ioat.so.7.0 00:01:49.163 SYMLINK libspdk_dma.so 00:01:49.163 SYMLINK libspdk_ioat.so 00:01:49.163 LIB libspdk_vfio_user.a 00:01:49.163 SO libspdk_vfio_user.so.5.0 00:01:49.163 LIB libspdk_util.a 00:01:49.163 SYMLINK libspdk_vfio_user.so 00:01:49.421 SO libspdk_util.so.9.0 00:01:49.421 SYMLINK libspdk_util.so 00:01:49.421 LIB libspdk_trace_parser.a 00:01:49.421 SO libspdk_trace_parser.so.5.0 00:01:49.679 SYMLINK libspdk_trace_parser.so 00:01:49.679 CC lib/conf/conf.o 00:01:49.679 CC lib/json/json_parse.o 00:01:49.679 CC lib/json/json_util.o 00:01:49.679 CC lib/json/json_write.o 00:01:49.679 CC lib/env_dpdk/env.o 00:01:49.679 CC lib/rdma/common.o 00:01:49.679 CC lib/rdma/rdma_verbs.o 00:01:49.679 CC lib/env_dpdk/pci.o 00:01:49.679 CC lib/env_dpdk/memory.o 00:01:49.679 CC lib/env_dpdk/init.o 00:01:49.679 CC lib/env_dpdk/threads.o 00:01:49.679 CC lib/env_dpdk/pci_vmd.o 00:01:49.679 CC lib/env_dpdk/pci_ioat.o 00:01:49.679 CC lib/env_dpdk/pci_virtio.o 00:01:49.679 CC lib/env_dpdk/pci_idxd.o 00:01:49.679 CC lib/env_dpdk/pci_event.o 00:01:49.679 CC lib/env_dpdk/sigbus_handler.o 00:01:49.679 CC lib/env_dpdk/pci_dpdk.o 00:01:49.679 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:49.679 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:49.679 CC lib/vmd/vmd.o 00:01:49.679 CC lib/vmd/led.o 00:01:49.680 CC lib/idxd/idxd.o 00:01:49.680 CC lib/idxd/idxd_user.o 00:01:49.938 LIB libspdk_conf.a 00:01:49.938 SO libspdk_conf.so.6.0 00:01:49.938 SYMLINK libspdk_conf.so 00:01:49.938 LIB libspdk_rdma.a 00:01:49.938 LIB libspdk_json.a 00:01:50.196 SO libspdk_rdma.so.6.0 00:01:50.196 SO libspdk_json.so.6.0 00:01:50.196 SYMLINK libspdk_rdma.so 00:01:50.196 SYMLINK libspdk_json.so 00:01:50.196 LIB libspdk_idxd.a 00:01:50.196 SO libspdk_idxd.so.12.0 00:01:50.196 LIB libspdk_vmd.a 00:01:50.454 SO libspdk_vmd.so.6.0 00:01:50.454 SYMLINK libspdk_idxd.so 00:01:50.454 SYMLINK libspdk_vmd.so 00:01:50.454 CC lib/jsonrpc/jsonrpc_server.o 00:01:50.454 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:50.454 CC lib/jsonrpc/jsonrpc_client.o 00:01:50.454 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:50.713 LIB libspdk_jsonrpc.a 00:01:50.713 SO libspdk_jsonrpc.so.6.0 00:01:50.713 LIB libspdk_env_dpdk.a 00:01:50.971 SYMLINK libspdk_jsonrpc.so 00:01:50.971 SO libspdk_env_dpdk.so.14.0 00:01:50.971 SYMLINK libspdk_env_dpdk.so 00:01:51.229 CC lib/rpc/rpc.o 00:01:51.487 LIB libspdk_rpc.a 00:01:51.487 SO libspdk_rpc.so.6.0 00:01:51.487 SYMLINK libspdk_rpc.so 00:01:51.744 CC lib/trace/trace.o 00:01:51.744 CC lib/keyring/keyring.o 00:01:51.744 CC lib/trace/trace_rpc.o 00:01:51.744 CC lib/trace/trace_flags.o 00:01:51.744 CC lib/keyring/keyring_rpc.o 00:01:51.744 CC lib/notify/notify.o 00:01:51.744 CC lib/notify/notify_rpc.o 00:01:52.002 LIB libspdk_notify.a 00:01:52.002 LIB libspdk_trace.a 00:01:52.002 LIB libspdk_keyring.a 00:01:52.002 SO libspdk_notify.so.6.0 00:01:52.002 SO libspdk_keyring.so.1.0 00:01:52.002 SO libspdk_trace.so.10.0 00:01:52.002 SYMLINK libspdk_notify.so 00:01:52.002 SYMLINK libspdk_keyring.so 00:01:52.259 SYMLINK libspdk_trace.so 00:01:52.517 CC lib/sock/sock.o 00:01:52.517 CC lib/sock/sock_rpc.o 00:01:52.517 CC lib/thread/thread.o 00:01:52.517 CC lib/thread/iobuf.o 00:01:52.774 LIB libspdk_sock.a 00:01:52.774 SO libspdk_sock.so.9.0 00:01:52.774 SYMLINK libspdk_sock.so 00:01:53.339 CC lib/nvme/nvme_ctrlr_cmd.o 00:01:53.339 CC lib/nvme/nvme_ctrlr.o 00:01:53.339 CC lib/nvme/nvme_fabric.o 00:01:53.339 CC lib/nvme/nvme_ns_cmd.o 00:01:53.339 CC lib/nvme/nvme_ns.o 00:01:53.339 CC lib/nvme/nvme_pcie_common.o 00:01:53.339 CC lib/nvme/nvme_pcie.o 00:01:53.339 CC lib/nvme/nvme_qpair.o 00:01:53.339 CC lib/nvme/nvme.o 00:01:53.339 CC lib/nvme/nvme_quirks.o 00:01:53.339 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:01:53.339 CC lib/nvme/nvme_transport.o 00:01:53.339 CC lib/nvme/nvme_discovery.o 00:01:53.339 CC lib/nvme/nvme_tcp.o 00:01:53.339 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:01:53.339 CC lib/nvme/nvme_opal.o 00:01:53.339 CC lib/nvme/nvme_io_msg.o 00:01:53.339 CC lib/nvme/nvme_poll_group.o 00:01:53.339 CC lib/nvme/nvme_zns.o 00:01:53.339 CC lib/nvme/nvme_stubs.o 00:01:53.339 CC lib/nvme/nvme_auth.o 00:01:53.339 CC lib/nvme/nvme_cuse.o 00:01:53.339 CC lib/nvme/nvme_rdma.o 00:01:53.597 LIB libspdk_thread.a 00:01:53.597 SO libspdk_thread.so.10.0 00:01:53.597 SYMLINK libspdk_thread.so 00:01:53.855 CC lib/init/subsystem_rpc.o 00:01:54.112 CC lib/init/rpc.o 00:01:54.112 CC lib/init/json_config.o 00:01:54.112 CC lib/init/subsystem.o 00:01:54.112 CC lib/virtio/virtio.o 00:01:54.112 CC lib/virtio/virtio_vfio_user.o 00:01:54.112 CC lib/virtio/virtio_vhost_user.o 00:01:54.112 CC lib/virtio/virtio_pci.o 00:01:54.112 CC lib/accel/accel_rpc.o 00:01:54.112 CC lib/accel/accel_sw.o 00:01:54.112 CC lib/accel/accel.o 00:01:54.112 CC lib/blob/blobstore.o 00:01:54.112 CC lib/blob/request.o 00:01:54.112 CC lib/blob/zeroes.o 00:01:54.112 CC lib/blob/blob_bs_dev.o 00:01:54.112 LIB libspdk_init.a 00:01:54.368 SO libspdk_init.so.5.0 00:01:54.368 LIB libspdk_virtio.a 00:01:54.368 SYMLINK libspdk_init.so 00:01:54.368 SO libspdk_virtio.so.7.0 00:01:54.368 SYMLINK libspdk_virtio.so 00:01:54.624 CC lib/event/app.o 00:01:54.624 CC lib/event/reactor.o 00:01:54.624 CC lib/event/log_rpc.o 00:01:54.624 CC lib/event/app_rpc.o 00:01:54.625 CC lib/event/scheduler_static.o 00:01:54.881 LIB libspdk_accel.a 00:01:54.881 SO libspdk_accel.so.15.0 00:01:54.881 LIB libspdk_nvme.a 00:01:54.881 SYMLINK libspdk_accel.so 00:01:54.881 LIB libspdk_event.a 00:01:54.881 SO libspdk_nvme.so.13.0 00:01:54.881 SO libspdk_event.so.13.0 00:01:55.139 SYMLINK libspdk_event.so 00:01:55.139 CC lib/bdev/bdev.o 00:01:55.139 CC lib/bdev/bdev_rpc.o 00:01:55.139 CC lib/bdev/bdev_zone.o 00:01:55.139 CC lib/bdev/part.o 00:01:55.139 CC lib/bdev/scsi_nvme.o 00:01:55.139 SYMLINK libspdk_nvme.so 00:01:56.072 LIB libspdk_blob.a 00:01:56.072 SO libspdk_blob.so.11.0 00:01:56.072 SYMLINK libspdk_blob.so 00:01:56.637 CC lib/blobfs/blobfs.o 00:01:56.637 CC lib/blobfs/tree.o 00:01:56.637 CC lib/lvol/lvol.o 00:01:56.894 LIB libspdk_bdev.a 00:01:57.151 LIB libspdk_blobfs.a 00:01:57.151 SO libspdk_bdev.so.15.0 00:01:57.151 SO libspdk_blobfs.so.10.0 00:01:57.151 LIB libspdk_lvol.a 00:01:57.151 SYMLINK libspdk_bdev.so 00:01:57.151 SYMLINK libspdk_blobfs.so 00:01:57.151 SO libspdk_lvol.so.10.0 00:01:57.151 SYMLINK libspdk_lvol.so 00:01:57.426 CC lib/scsi/dev.o 00:01:57.426 CC lib/scsi/lun.o 00:01:57.426 CC lib/scsi/port.o 00:01:57.426 CC lib/scsi/scsi.o 00:01:57.426 CC lib/scsi/scsi_rpc.o 00:01:57.426 CC lib/scsi/scsi_bdev.o 00:01:57.426 CC lib/scsi/scsi_pr.o 00:01:57.426 CC lib/scsi/task.o 00:01:57.426 CC lib/nvmf/ctrlr.o 00:01:57.426 CC lib/nvmf/ctrlr_discovery.o 00:01:57.426 CC lib/nvmf/ctrlr_bdev.o 00:01:57.426 CC lib/nvmf/subsystem.o 00:01:57.426 CC lib/nvmf/nvmf_rpc.o 00:01:57.426 CC lib/nvmf/nvmf.o 00:01:57.426 CC lib/nbd/nbd.o 00:01:57.426 CC lib/nvmf/transport.o 00:01:57.426 CC lib/nvmf/rdma.o 00:01:57.426 CC lib/nvmf/tcp.o 00:01:57.426 CC lib/nbd/nbd_rpc.o 00:01:57.426 CC lib/ublk/ublk.o 00:01:57.426 CC lib/ublk/ublk_rpc.o 00:01:57.426 CC lib/ftl/ftl_core.o 00:01:57.426 CC lib/ftl/ftl_init.o 00:01:57.426 CC lib/ftl/ftl_debug.o 00:01:57.426 CC lib/ftl/ftl_layout.o 00:01:57.426 CC lib/ftl/ftl_io.o 00:01:57.426 CC lib/ftl/ftl_sb.o 00:01:57.426 CC lib/ftl/ftl_l2p_flat.o 00:01:57.426 CC lib/ftl/ftl_l2p.o 00:01:57.426 CC lib/ftl/ftl_nv_cache.o 00:01:57.426 CC lib/ftl/ftl_band.o 00:01:57.426 CC lib/ftl/ftl_band_ops.o 00:01:57.426 CC lib/ftl/ftl_reloc.o 00:01:57.426 CC lib/ftl/ftl_writer.o 00:01:57.426 CC lib/ftl/ftl_rq.o 00:01:57.426 CC lib/ftl/mngt/ftl_mngt.o 00:01:57.426 CC lib/ftl/ftl_l2p_cache.o 00:01:57.426 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:01:57.426 CC lib/ftl/ftl_p2l.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_startup.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_md.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_misc.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_band.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:01:57.726 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:01:57.726 CC lib/ftl/utils/ftl_conf.o 00:01:57.726 CC lib/ftl/utils/ftl_md.o 00:01:57.726 CC lib/ftl/utils/ftl_bitmap.o 00:01:57.726 CC lib/ftl/utils/ftl_property.o 00:01:57.726 CC lib/ftl/utils/ftl_mempool.o 00:01:57.726 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:01:57.726 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:01:57.726 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:01:57.726 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:01:57.726 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:01:57.726 CC lib/ftl/upgrade/ftl_sb_v3.o 00:01:57.726 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:01:57.726 CC lib/ftl/upgrade/ftl_sb_v5.o 00:01:57.726 CC lib/ftl/nvc/ftl_nvc_dev.o 00:01:57.726 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:01:57.726 CC lib/ftl/base/ftl_base_bdev.o 00:01:57.726 CC lib/ftl/ftl_trace.o 00:01:57.726 CC lib/ftl/base/ftl_base_dev.o 00:01:57.984 LIB libspdk_nbd.a 00:01:57.984 LIB libspdk_scsi.a 00:01:57.984 SO libspdk_nbd.so.7.0 00:01:58.241 SO libspdk_scsi.so.9.0 00:01:58.241 SYMLINK libspdk_nbd.so 00:01:58.241 LIB libspdk_ublk.a 00:01:58.241 SO libspdk_ublk.so.3.0 00:01:58.241 SYMLINK libspdk_scsi.so 00:01:58.241 SYMLINK libspdk_ublk.so 00:01:58.498 LIB libspdk_ftl.a 00:01:58.498 CC lib/vhost/vhost.o 00:01:58.498 CC lib/vhost/vhost_rpc.o 00:01:58.498 CC lib/vhost/vhost_scsi.o 00:01:58.498 CC lib/vhost/vhost_blk.o 00:01:58.498 CC lib/vhost/rte_vhost_user.o 00:01:58.498 CC lib/iscsi/conn.o 00:01:58.498 CC lib/iscsi/iscsi.o 00:01:58.498 CC lib/iscsi/init_grp.o 00:01:58.498 CC lib/iscsi/md5.o 00:01:58.498 CC lib/iscsi/tgt_node.o 00:01:58.498 CC lib/iscsi/param.o 00:01:58.498 CC lib/iscsi/portal_grp.o 00:01:58.498 CC lib/iscsi/iscsi_subsystem.o 00:01:58.498 CC lib/iscsi/iscsi_rpc.o 00:01:58.498 CC lib/iscsi/task.o 00:01:58.755 SO libspdk_ftl.so.9.0 00:01:59.011 SYMLINK libspdk_ftl.so 00:01:59.268 LIB libspdk_nvmf.a 00:01:59.268 SO libspdk_nvmf.so.18.0 00:01:59.268 LIB libspdk_vhost.a 00:01:59.526 SO libspdk_vhost.so.8.0 00:01:59.526 SYMLINK libspdk_nvmf.so 00:01:59.526 SYMLINK libspdk_vhost.so 00:01:59.526 LIB libspdk_iscsi.a 00:01:59.784 SO libspdk_iscsi.so.8.0 00:01:59.784 SYMLINK libspdk_iscsi.so 00:02:00.348 CC module/env_dpdk/env_dpdk_rpc.o 00:02:00.607 CC module/accel/dsa/accel_dsa.o 00:02:00.607 CC module/accel/dsa/accel_dsa_rpc.o 00:02:00.607 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:00.607 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:00.607 CC module/scheduler/gscheduler/gscheduler.o 00:02:00.607 LIB libspdk_env_dpdk_rpc.a 00:02:00.607 CC module/blob/bdev/blob_bdev.o 00:02:00.607 CC module/sock/posix/posix.o 00:02:00.607 CC module/accel/iaa/accel_iaa.o 00:02:00.607 CC module/accel/iaa/accel_iaa_rpc.o 00:02:00.607 CC module/accel/ioat/accel_ioat_rpc.o 00:02:00.607 CC module/accel/ioat/accel_ioat.o 00:02:00.607 CC module/accel/error/accel_error_rpc.o 00:02:00.607 CC module/accel/error/accel_error.o 00:02:00.607 CC module/keyring/file/keyring.o 00:02:00.607 CC module/keyring/file/keyring_rpc.o 00:02:00.607 SO libspdk_env_dpdk_rpc.so.6.0 00:02:00.607 SYMLINK libspdk_env_dpdk_rpc.so 00:02:00.607 LIB libspdk_scheduler_dpdk_governor.a 00:02:00.607 LIB libspdk_scheduler_gscheduler.a 00:02:00.607 LIB libspdk_scheduler_dynamic.a 00:02:00.607 LIB libspdk_keyring_file.a 00:02:00.607 LIB libspdk_accel_dsa.a 00:02:00.607 SO libspdk_scheduler_dpdk_governor.so.4.0 00:02:00.607 SO libspdk_scheduler_gscheduler.so.4.0 00:02:00.607 SO libspdk_scheduler_dynamic.so.4.0 00:02:00.607 LIB libspdk_accel_iaa.a 00:02:00.607 LIB libspdk_accel_ioat.a 00:02:00.607 SO libspdk_keyring_file.so.1.0 00:02:00.607 LIB libspdk_accel_error.a 00:02:00.865 SO libspdk_accel_dsa.so.5.0 00:02:00.865 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:00.865 SO libspdk_accel_iaa.so.3.0 00:02:00.865 SYMLINK libspdk_scheduler_gscheduler.so 00:02:00.865 SO libspdk_accel_ioat.so.6.0 00:02:00.865 SYMLINK libspdk_scheduler_dynamic.so 00:02:00.865 SYMLINK libspdk_keyring_file.so 00:02:00.865 SO libspdk_accel_error.so.2.0 00:02:00.865 LIB libspdk_blob_bdev.a 00:02:00.866 SYMLINK libspdk_accel_dsa.so 00:02:00.866 SYMLINK libspdk_accel_ioat.so 00:02:00.866 SYMLINK libspdk_accel_iaa.so 00:02:00.866 SO libspdk_blob_bdev.so.11.0 00:02:00.866 SYMLINK libspdk_accel_error.so 00:02:00.866 SYMLINK libspdk_blob_bdev.so 00:02:01.124 LIB libspdk_sock_posix.a 00:02:01.124 SO libspdk_sock_posix.so.6.0 00:02:01.124 SYMLINK libspdk_sock_posix.so 00:02:01.383 CC module/bdev/gpt/vbdev_gpt.o 00:02:01.383 CC module/bdev/gpt/gpt.o 00:02:01.383 CC module/bdev/ftl/bdev_ftl.o 00:02:01.383 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:01.383 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:01.383 CC module/bdev/delay/vbdev_delay.o 00:02:01.383 CC module/bdev/nvme/bdev_nvme.o 00:02:01.383 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:01.383 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:01.383 CC module/bdev/split/vbdev_split_rpc.o 00:02:01.383 CC module/bdev/nvme/nvme_rpc.o 00:02:01.383 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:01.383 CC module/bdev/raid/bdev_raid_rpc.o 00:02:01.383 CC module/bdev/split/vbdev_split.o 00:02:01.383 CC module/bdev/error/vbdev_error.o 00:02:01.383 CC module/bdev/raid/bdev_raid_sb.o 00:02:01.383 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:01.383 CC module/bdev/nvme/bdev_mdns_client.o 00:02:01.383 CC module/bdev/raid/bdev_raid.o 00:02:01.383 CC module/bdev/error/vbdev_error_rpc.o 00:02:01.383 CC module/bdev/malloc/bdev_malloc.o 00:02:01.383 CC module/bdev/raid/raid0.o 00:02:01.383 CC module/bdev/nvme/vbdev_opal.o 00:02:01.383 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:01.383 CC module/bdev/raid/concat.o 00:02:01.383 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:01.383 CC module/bdev/raid/raid1.o 00:02:01.383 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:01.383 CC module/bdev/passthru/vbdev_passthru.o 00:02:01.383 CC module/bdev/null/bdev_null.o 00:02:01.383 CC module/bdev/null/bdev_null_rpc.o 00:02:01.383 CC module/bdev/aio/bdev_aio.o 00:02:01.383 CC module/bdev/aio/bdev_aio_rpc.o 00:02:01.383 CC module/blobfs/bdev/blobfs_bdev.o 00:02:01.383 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:01.383 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:01.383 CC module/bdev/lvol/vbdev_lvol.o 00:02:01.383 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:01.383 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:01.383 CC module/bdev/iscsi/bdev_iscsi.o 00:02:01.383 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:01.383 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:01.642 LIB libspdk_blobfs_bdev.a 00:02:01.642 LIB libspdk_bdev_gpt.a 00:02:01.642 LIB libspdk_bdev_ftl.a 00:02:01.642 SO libspdk_blobfs_bdev.so.6.0 00:02:01.642 LIB libspdk_bdev_split.a 00:02:01.642 SO libspdk_bdev_ftl.so.6.0 00:02:01.642 LIB libspdk_bdev_passthru.a 00:02:01.642 SO libspdk_bdev_gpt.so.6.0 00:02:01.642 LIB libspdk_bdev_null.a 00:02:01.642 LIB libspdk_bdev_error.a 00:02:01.642 SO libspdk_bdev_split.so.6.0 00:02:01.642 LIB libspdk_bdev_zone_block.a 00:02:01.642 SYMLINK libspdk_blobfs_bdev.so 00:02:01.642 SO libspdk_bdev_passthru.so.6.0 00:02:01.642 LIB libspdk_bdev_aio.a 00:02:01.642 SO libspdk_bdev_null.so.6.0 00:02:01.642 SO libspdk_bdev_error.so.6.0 00:02:01.642 SO libspdk_bdev_zone_block.so.6.0 00:02:01.642 SYMLINK libspdk_bdev_ftl.so 00:02:01.642 SYMLINK libspdk_bdev_gpt.so 00:02:01.642 LIB libspdk_bdev_malloc.a 00:02:01.642 SO libspdk_bdev_aio.so.6.0 00:02:01.642 SYMLINK libspdk_bdev_split.so 00:02:01.642 LIB libspdk_bdev_delay.a 00:02:01.900 SYMLINK libspdk_bdev_passthru.so 00:02:01.900 SO libspdk_bdev_malloc.so.6.0 00:02:01.900 SYMLINK libspdk_bdev_null.so 00:02:01.900 SO libspdk_bdev_delay.so.6.0 00:02:01.900 SYMLINK libspdk_bdev_error.so 00:02:01.900 SYMLINK libspdk_bdev_zone_block.so 00:02:01.900 SYMLINK libspdk_bdev_aio.so 00:02:01.900 LIB libspdk_bdev_iscsi.a 00:02:01.900 SYMLINK libspdk_bdev_delay.so 00:02:01.900 SYMLINK libspdk_bdev_malloc.so 00:02:01.900 SO libspdk_bdev_iscsi.so.6.0 00:02:01.900 LIB libspdk_bdev_virtio.a 00:02:01.900 LIB libspdk_bdev_lvol.a 00:02:01.900 SO libspdk_bdev_virtio.so.6.0 00:02:01.900 SYMLINK libspdk_bdev_iscsi.so 00:02:01.900 SO libspdk_bdev_lvol.so.6.0 00:02:01.900 SYMLINK libspdk_bdev_virtio.so 00:02:01.900 SYMLINK libspdk_bdev_lvol.so 00:02:02.182 LIB libspdk_bdev_raid.a 00:02:02.182 SO libspdk_bdev_raid.so.6.0 00:02:02.182 SYMLINK libspdk_bdev_raid.so 00:02:03.116 LIB libspdk_bdev_nvme.a 00:02:03.116 SO libspdk_bdev_nvme.so.7.0 00:02:03.116 SYMLINK libspdk_bdev_nvme.so 00:02:04.048 CC module/event/subsystems/vmd/vmd.o 00:02:04.048 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:04.048 CC module/event/subsystems/sock/sock.o 00:02:04.048 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:04.048 CC module/event/subsystems/iobuf/iobuf.o 00:02:04.048 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:04.048 CC module/event/subsystems/scheduler/scheduler.o 00:02:04.048 CC module/event/subsystems/keyring/keyring.o 00:02:04.048 LIB libspdk_event_sock.a 00:02:04.048 LIB libspdk_event_vmd.a 00:02:04.048 LIB libspdk_event_scheduler.a 00:02:04.048 LIB libspdk_event_keyring.a 00:02:04.048 LIB libspdk_event_vhost_blk.a 00:02:04.048 SO libspdk_event_sock.so.5.0 00:02:04.048 SO libspdk_event_vmd.so.6.0 00:02:04.048 LIB libspdk_event_iobuf.a 00:02:04.048 SO libspdk_event_keyring.so.1.0 00:02:04.048 SO libspdk_event_vhost_blk.so.3.0 00:02:04.048 SO libspdk_event_scheduler.so.4.0 00:02:04.048 SO libspdk_event_iobuf.so.3.0 00:02:04.048 SYMLINK libspdk_event_vmd.so 00:02:04.048 SYMLINK libspdk_event_sock.so 00:02:04.048 SYMLINK libspdk_event_keyring.so 00:02:04.048 SYMLINK libspdk_event_vhost_blk.so 00:02:04.048 SYMLINK libspdk_event_scheduler.so 00:02:04.048 SYMLINK libspdk_event_iobuf.so 00:02:04.614 CC module/event/subsystems/accel/accel.o 00:02:04.614 LIB libspdk_event_accel.a 00:02:04.614 SO libspdk_event_accel.so.6.0 00:02:04.873 SYMLINK libspdk_event_accel.so 00:02:05.131 CC module/event/subsystems/bdev/bdev.o 00:02:05.389 LIB libspdk_event_bdev.a 00:02:05.389 SO libspdk_event_bdev.so.6.0 00:02:05.389 SYMLINK libspdk_event_bdev.so 00:02:05.647 CC module/event/subsystems/nbd/nbd.o 00:02:05.647 CC module/event/subsystems/scsi/scsi.o 00:02:05.647 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:05.648 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:05.648 CC module/event/subsystems/ublk/ublk.o 00:02:05.906 LIB libspdk_event_nbd.a 00:02:05.906 LIB libspdk_event_scsi.a 00:02:05.906 LIB libspdk_event_ublk.a 00:02:05.906 SO libspdk_event_nbd.so.6.0 00:02:05.906 SO libspdk_event_scsi.so.6.0 00:02:05.906 SO libspdk_event_ublk.so.3.0 00:02:05.906 LIB libspdk_event_nvmf.a 00:02:05.906 SYMLINK libspdk_event_scsi.so 00:02:05.906 SYMLINK libspdk_event_nbd.so 00:02:05.906 SO libspdk_event_nvmf.so.6.0 00:02:05.906 SYMLINK libspdk_event_ublk.so 00:02:06.165 SYMLINK libspdk_event_nvmf.so 00:02:06.165 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:06.423 CC module/event/subsystems/iscsi/iscsi.o 00:02:06.423 LIB libspdk_event_vhost_scsi.a 00:02:06.423 SO libspdk_event_vhost_scsi.so.3.0 00:02:06.423 LIB libspdk_event_iscsi.a 00:02:06.423 SYMLINK libspdk_event_vhost_scsi.so 00:02:06.423 SO libspdk_event_iscsi.so.6.0 00:02:06.681 SYMLINK libspdk_event_iscsi.so 00:02:06.681 SO libspdk.so.6.0 00:02:06.939 SYMLINK libspdk.so 00:02:07.207 TEST_HEADER include/spdk/accel.h 00:02:07.207 TEST_HEADER include/spdk/assert.h 00:02:07.207 TEST_HEADER include/spdk/barrier.h 00:02:07.207 TEST_HEADER include/spdk/base64.h 00:02:07.207 TEST_HEADER include/spdk/bdev_module.h 00:02:07.207 TEST_HEADER include/spdk/bdev.h 00:02:07.207 TEST_HEADER include/spdk/accel_module.h 00:02:07.207 TEST_HEADER include/spdk/bdev_zone.h 00:02:07.207 TEST_HEADER include/spdk/bit_array.h 00:02:07.207 TEST_HEADER include/spdk/bit_pool.h 00:02:07.207 TEST_HEADER include/spdk/blobfs.h 00:02:07.207 TEST_HEADER include/spdk/blob_bdev.h 00:02:07.207 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:07.207 TEST_HEADER include/spdk/blob.h 00:02:07.207 TEST_HEADER include/spdk/conf.h 00:02:07.207 CC test/rpc_client/rpc_client_test.o 00:02:07.207 TEST_HEADER include/spdk/cpuset.h 00:02:07.207 TEST_HEADER include/spdk/config.h 00:02:07.207 TEST_HEADER include/spdk/crc16.h 00:02:07.207 TEST_HEADER include/spdk/crc32.h 00:02:07.207 TEST_HEADER include/spdk/crc64.h 00:02:07.207 TEST_HEADER include/spdk/dif.h 00:02:07.207 CXX app/trace/trace.o 00:02:07.207 TEST_HEADER include/spdk/dma.h 00:02:07.207 TEST_HEADER include/spdk/endian.h 00:02:07.207 TEST_HEADER include/spdk/env.h 00:02:07.207 TEST_HEADER include/spdk/env_dpdk.h 00:02:07.207 TEST_HEADER include/spdk/event.h 00:02:07.207 TEST_HEADER include/spdk/fd_group.h 00:02:07.207 CC app/spdk_nvme_identify/identify.o 00:02:07.207 TEST_HEADER include/spdk/fd.h 00:02:07.207 CC app/spdk_top/spdk_top.o 00:02:07.207 CC app/spdk_lspci/spdk_lspci.o 00:02:07.207 CC app/spdk_nvme_perf/perf.o 00:02:07.207 TEST_HEADER include/spdk/file.h 00:02:07.207 CC app/spdk_nvme_discover/discovery_aer.o 00:02:07.207 TEST_HEADER include/spdk/ftl.h 00:02:07.207 TEST_HEADER include/spdk/gpt_spec.h 00:02:07.207 TEST_HEADER include/spdk/hexlify.h 00:02:07.207 TEST_HEADER include/spdk/histogram_data.h 00:02:07.207 CC app/trace_record/trace_record.o 00:02:07.207 TEST_HEADER include/spdk/idxd.h 00:02:07.207 TEST_HEADER include/spdk/idxd_spec.h 00:02:07.207 TEST_HEADER include/spdk/init.h 00:02:07.207 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:07.207 TEST_HEADER include/spdk/ioat.h 00:02:07.207 TEST_HEADER include/spdk/ioat_spec.h 00:02:07.207 TEST_HEADER include/spdk/iscsi_spec.h 00:02:07.207 TEST_HEADER include/spdk/json.h 00:02:07.207 TEST_HEADER include/spdk/jsonrpc.h 00:02:07.207 TEST_HEADER include/spdk/keyring.h 00:02:07.207 TEST_HEADER include/spdk/keyring_module.h 00:02:07.207 TEST_HEADER include/spdk/likely.h 00:02:07.207 TEST_HEADER include/spdk/log.h 00:02:07.207 CC app/nvmf_tgt/nvmf_main.o 00:02:07.207 TEST_HEADER include/spdk/lvol.h 00:02:07.207 CC app/spdk_dd/spdk_dd.o 00:02:07.207 CC app/vhost/vhost.o 00:02:07.207 TEST_HEADER include/spdk/memory.h 00:02:07.207 CC app/iscsi_tgt/iscsi_tgt.o 00:02:07.207 TEST_HEADER include/spdk/mmio.h 00:02:07.207 TEST_HEADER include/spdk/nbd.h 00:02:07.207 TEST_HEADER include/spdk/notify.h 00:02:07.207 TEST_HEADER include/spdk/nvme.h 00:02:07.207 TEST_HEADER include/spdk/nvme_intel.h 00:02:07.207 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:07.207 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:07.207 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:07.207 TEST_HEADER include/spdk/nvme_spec.h 00:02:07.207 CC examples/nvme/reconnect/reconnect.o 00:02:07.207 CC examples/nvme/hotplug/hotplug.o 00:02:07.207 TEST_HEADER include/spdk/nvme_zns.h 00:02:07.207 CC test/app/stub/stub.o 00:02:07.207 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:07.207 CC test/nvme/sgl/sgl.o 00:02:07.207 CC test/event/event_perf/event_perf.o 00:02:07.207 CC app/spdk_tgt/spdk_tgt.o 00:02:07.207 CC examples/nvme/abort/abort.o 00:02:07.207 CC test/env/pci/pci_ut.o 00:02:07.207 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:07.207 CC examples/accel/perf/accel_perf.o 00:02:07.207 CC test/app/histogram_perf/histogram_perf.o 00:02:07.207 CC test/nvme/aer/aer.o 00:02:07.207 TEST_HEADER include/spdk/nvmf.h 00:02:07.207 CC test/event/reactor/reactor.o 00:02:07.207 CC test/nvme/startup/startup.o 00:02:07.207 TEST_HEADER include/spdk/nvmf_spec.h 00:02:07.207 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:07.466 TEST_HEADER include/spdk/nvmf_transport.h 00:02:07.466 CC test/nvme/reset/reset.o 00:02:07.466 CC test/event/reactor_perf/reactor_perf.o 00:02:07.466 CC examples/nvme/arbitration/arbitration.o 00:02:07.466 TEST_HEADER include/spdk/opal.h 00:02:07.466 CC test/nvme/err_injection/err_injection.o 00:02:07.466 CC examples/util/zipf/zipf.o 00:02:07.466 CC test/app/jsoncat/jsoncat.o 00:02:07.466 CC test/env/vtophys/vtophys.o 00:02:07.466 TEST_HEADER include/spdk/opal_spec.h 00:02:07.466 CC examples/ioat/perf/perf.o 00:02:07.466 CC test/thread/poller_perf/poller_perf.o 00:02:07.466 CC examples/idxd/perf/perf.o 00:02:07.466 CC examples/sock/hello_world/hello_sock.o 00:02:07.466 CC test/nvme/boot_partition/boot_partition.o 00:02:07.466 CC test/event/app_repeat/app_repeat.o 00:02:07.466 CC test/nvme/overhead/overhead.o 00:02:07.466 CC examples/ioat/verify/verify.o 00:02:07.466 CC test/nvme/fused_ordering/fused_ordering.o 00:02:07.466 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:07.466 TEST_HEADER include/spdk/pci_ids.h 00:02:07.466 CC test/nvme/connect_stress/connect_stress.o 00:02:07.466 CC examples/nvme/hello_world/hello_world.o 00:02:07.466 CC test/nvme/e2edp/nvme_dp.o 00:02:07.466 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:07.466 CC test/nvme/simple_copy/simple_copy.o 00:02:07.466 CC app/fio/nvme/fio_plugin.o 00:02:07.466 CC examples/vmd/lsvmd/lsvmd.o 00:02:07.466 CC test/nvme/reserve/reserve.o 00:02:07.466 TEST_HEADER include/spdk/pipe.h 00:02:07.466 CC examples/vmd/led/led.o 00:02:07.466 TEST_HEADER include/spdk/queue.h 00:02:07.466 CC test/env/memory/memory_ut.o 00:02:07.466 TEST_HEADER include/spdk/reduce.h 00:02:07.466 TEST_HEADER include/spdk/rpc.h 00:02:07.466 CC examples/bdev/bdevperf/bdevperf.o 00:02:07.466 TEST_HEADER include/spdk/scheduler.h 00:02:07.466 CC test/accel/dif/dif.o 00:02:07.466 CC test/blobfs/mkfs/mkfs.o 00:02:07.466 TEST_HEADER include/spdk/scsi.h 00:02:07.466 TEST_HEADER include/spdk/scsi_spec.h 00:02:07.466 TEST_HEADER include/spdk/sock.h 00:02:07.466 CC test/dma/test_dma/test_dma.o 00:02:07.466 CC test/nvme/compliance/nvme_compliance.o 00:02:07.466 TEST_HEADER include/spdk/stdinc.h 00:02:07.466 CC examples/bdev/hello_world/hello_bdev.o 00:02:07.466 CC test/app/bdev_svc/bdev_svc.o 00:02:07.466 TEST_HEADER include/spdk/string.h 00:02:07.466 CC examples/nvmf/nvmf/nvmf.o 00:02:07.466 CC examples/blob/cli/blobcli.o 00:02:07.466 TEST_HEADER include/spdk/thread.h 00:02:07.466 CC examples/thread/thread/thread_ex.o 00:02:07.466 CC test/event/scheduler/scheduler.o 00:02:07.466 TEST_HEADER include/spdk/trace.h 00:02:07.466 CC examples/blob/hello_world/hello_blob.o 00:02:07.466 TEST_HEADER include/spdk/trace_parser.h 00:02:07.466 CC test/bdev/bdevio/bdevio.o 00:02:07.466 TEST_HEADER include/spdk/tree.h 00:02:07.466 TEST_HEADER include/spdk/ublk.h 00:02:07.466 TEST_HEADER include/spdk/util.h 00:02:07.466 TEST_HEADER include/spdk/uuid.h 00:02:07.466 TEST_HEADER include/spdk/version.h 00:02:07.466 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:07.466 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:07.466 TEST_HEADER include/spdk/vhost.h 00:02:07.466 TEST_HEADER include/spdk/vmd.h 00:02:07.466 TEST_HEADER include/spdk/xor.h 00:02:07.466 TEST_HEADER include/spdk/zipf.h 00:02:07.466 CXX test/cpp_headers/accel.o 00:02:07.466 CC test/env/mem_callbacks/mem_callbacks.o 00:02:07.466 LINK rpc_client_test 00:02:07.466 CC test/lvol/esnap/esnap.o 00:02:07.466 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:07.466 LINK spdk_lspci 00:02:07.757 LINK interrupt_tgt 00:02:07.757 LINK reactor_perf 00:02:07.757 LINK vhost 00:02:07.757 LINK spdk_nvme_discover 00:02:07.757 LINK poller_perf 00:02:07.757 LINK lsvmd 00:02:07.757 LINK app_repeat 00:02:07.757 LINK nvmf_tgt 00:02:07.757 LINK spdk_trace_record 00:02:07.757 LINK cmb_copy 00:02:07.757 LINK startup 00:02:07.757 LINK stub 00:02:07.757 LINK reactor 00:02:07.757 LINK env_dpdk_post_init 00:02:07.757 LINK jsoncat 00:02:07.757 LINK pmr_persistence 00:02:07.757 LINK event_perf 00:02:07.757 LINK histogram_perf 00:02:07.757 LINK vtophys 00:02:07.757 LINK zipf 00:02:07.757 LINK spdk_tgt 00:02:07.757 LINK iscsi_tgt 00:02:07.757 LINK hotplug 00:02:07.757 LINK fused_ordering 00:02:07.757 LINK led 00:02:07.757 LINK boot_partition 00:02:07.757 LINK err_injection 00:02:07.757 LINK bdev_svc 00:02:07.757 LINK hello_sock 00:02:07.757 LINK connect_stress 00:02:07.757 LINK ioat_perf 00:02:07.757 LINK mkfs 00:02:07.757 LINK reset 00:02:07.757 LINK reserve 00:02:07.757 LINK sgl 00:02:07.757 LINK verify 00:02:07.757 LINK scheduler 00:02:07.757 LINK aer 00:02:07.757 LINK hello_world 00:02:07.757 LINK nvme_dp 00:02:07.757 LINK simple_copy 00:02:08.017 LINK spdk_trace 00:02:08.017 LINK spdk_dd 00:02:08.017 CXX test/cpp_headers/accel_module.o 00:02:08.017 LINK hello_blob 00:02:08.017 LINK reconnect 00:02:08.017 LINK hello_bdev 00:02:08.017 LINK overhead 00:02:08.017 LINK thread 00:02:08.018 CXX test/cpp_headers/assert.o 00:02:08.018 LINK abort 00:02:08.018 CXX test/cpp_headers/barrier.o 00:02:08.018 LINK nvme_compliance 00:02:08.018 LINK nvmf 00:02:08.018 LINK arbitration 00:02:08.018 LINK dif 00:02:08.018 LINK idxd_perf 00:02:08.018 LINK test_dma 00:02:08.018 CXX test/cpp_headers/base64.o 00:02:08.018 LINK pci_ut 00:02:08.018 LINK accel_perf 00:02:08.018 CXX test/cpp_headers/bdev.o 00:02:08.018 CXX test/cpp_headers/bdev_module.o 00:02:08.018 CXX test/cpp_headers/bdev_zone.o 00:02:08.018 CXX test/cpp_headers/bit_array.o 00:02:08.290 CXX test/cpp_headers/bit_pool.o 00:02:08.290 CXX test/cpp_headers/blob_bdev.o 00:02:08.290 CXX test/cpp_headers/blobfs_bdev.o 00:02:08.290 CXX test/cpp_headers/blobfs.o 00:02:08.290 LINK bdevio 00:02:08.290 CXX test/cpp_headers/blob.o 00:02:08.290 CXX test/cpp_headers/conf.o 00:02:08.290 CXX test/cpp_headers/config.o 00:02:08.290 CXX test/cpp_headers/cpuset.o 00:02:08.290 CXX test/cpp_headers/crc16.o 00:02:08.290 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:08.290 LINK nvme_fuzz 00:02:08.290 CXX test/cpp_headers/crc32.o 00:02:08.290 CXX test/cpp_headers/crc64.o 00:02:08.290 CXX test/cpp_headers/dif.o 00:02:08.290 CXX test/cpp_headers/dma.o 00:02:08.290 LINK nvme_manage 00:02:08.290 CXX test/cpp_headers/endian.o 00:02:08.290 CXX test/cpp_headers/env_dpdk.o 00:02:08.290 CXX test/cpp_headers/env.o 00:02:08.290 CXX test/cpp_headers/event.o 00:02:08.290 CXX test/cpp_headers/fd_group.o 00:02:08.290 CXX test/cpp_headers/fd.o 00:02:08.290 CXX test/cpp_headers/file.o 00:02:08.290 CXX test/cpp_headers/ftl.o 00:02:08.290 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:08.290 CXX test/cpp_headers/gpt_spec.o 00:02:08.290 CC app/fio/bdev/fio_plugin.o 00:02:08.290 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:08.290 CXX test/cpp_headers/hexlify.o 00:02:08.290 CC test/nvme/fdp/fdp.o 00:02:08.290 CXX test/cpp_headers/histogram_data.o 00:02:08.290 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:08.290 CXX test/cpp_headers/idxd.o 00:02:08.290 CXX test/cpp_headers/idxd_spec.o 00:02:08.290 CXX test/cpp_headers/init.o 00:02:08.290 CXX test/cpp_headers/ioat.o 00:02:08.290 CXX test/cpp_headers/ioat_spec.o 00:02:08.290 CXX test/cpp_headers/iscsi_spec.o 00:02:08.290 LINK spdk_nvme 00:02:08.290 CC test/nvme/cuse/cuse.o 00:02:08.290 LINK blobcli 00:02:08.290 CXX test/cpp_headers/json.o 00:02:08.290 CXX test/cpp_headers/jsonrpc.o 00:02:08.290 CXX test/cpp_headers/keyring.o 00:02:08.290 CXX test/cpp_headers/keyring_module.o 00:02:08.290 CXX test/cpp_headers/likely.o 00:02:08.290 CXX test/cpp_headers/log.o 00:02:08.290 CXX test/cpp_headers/lvol.o 00:02:08.290 CXX test/cpp_headers/memory.o 00:02:08.290 CXX test/cpp_headers/mmio.o 00:02:08.290 CXX test/cpp_headers/nbd.o 00:02:08.290 CXX test/cpp_headers/notify.o 00:02:08.290 CXX test/cpp_headers/nvme_intel.o 00:02:08.290 CXX test/cpp_headers/nvme.o 00:02:08.551 CXX test/cpp_headers/nvme_ocssd.o 00:02:08.551 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:08.551 CXX test/cpp_headers/nvme_spec.o 00:02:08.551 CXX test/cpp_headers/nvme_zns.o 00:02:08.551 CXX test/cpp_headers/nvmf_cmd.o 00:02:08.551 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:08.551 CXX test/cpp_headers/nvmf.o 00:02:08.551 CXX test/cpp_headers/nvmf_spec.o 00:02:08.551 LINK mem_callbacks 00:02:08.551 CXX test/cpp_headers/nvmf_transport.o 00:02:08.551 CXX test/cpp_headers/opal.o 00:02:08.551 LINK spdk_nvme_perf 00:02:08.551 CXX test/cpp_headers/opal_spec.o 00:02:08.551 CXX test/cpp_headers/pci_ids.o 00:02:08.551 CXX test/cpp_headers/pipe.o 00:02:08.551 CXX test/cpp_headers/rpc.o 00:02:08.551 CXX test/cpp_headers/reduce.o 00:02:08.551 CXX test/cpp_headers/queue.o 00:02:08.551 CXX test/cpp_headers/scheduler.o 00:02:08.551 CXX test/cpp_headers/scsi.o 00:02:08.551 CXX test/cpp_headers/scsi_spec.o 00:02:08.551 CXX test/cpp_headers/sock.o 00:02:08.551 CXX test/cpp_headers/stdinc.o 00:02:08.551 CXX test/cpp_headers/string.o 00:02:08.551 LINK doorbell_aers 00:02:08.551 CXX test/cpp_headers/thread.o 00:02:08.551 CXX test/cpp_headers/trace.o 00:02:08.551 CXX test/cpp_headers/trace_parser.o 00:02:08.808 LINK spdk_top 00:02:08.808 LINK spdk_nvme_identify 00:02:08.808 CXX test/cpp_headers/tree.o 00:02:08.808 LINK bdevperf 00:02:08.808 CXX test/cpp_headers/ublk.o 00:02:08.808 CXX test/cpp_headers/util.o 00:02:08.808 CXX test/cpp_headers/uuid.o 00:02:08.809 CXX test/cpp_headers/version.o 00:02:08.809 CXX test/cpp_headers/vfio_user_pci.o 00:02:08.809 CXX test/cpp_headers/vfio_user_spec.o 00:02:08.809 CXX test/cpp_headers/vhost.o 00:02:08.809 CXX test/cpp_headers/vmd.o 00:02:08.809 CXX test/cpp_headers/xor.o 00:02:08.809 CXX test/cpp_headers/zipf.o 00:02:08.809 LINK memory_ut 00:02:09.066 LINK fdp 00:02:09.066 LINK vhost_fuzz 00:02:09.066 LINK spdk_bdev 00:02:09.632 LINK cuse 00:02:09.890 LINK iscsi_fuzz 00:02:11.791 LINK esnap 00:02:12.050 00:02:12.050 real 0m48.377s 00:02:12.050 user 7m0.018s 00:02:12.050 sys 3m15.413s 00:02:12.050 17:50:21 -- common/autotest_common.sh@1122 -- $ xtrace_disable 00:02:12.050 17:50:21 -- common/autotest_common.sh@10 -- $ set +x 00:02:12.050 ************************************ 00:02:12.050 END TEST make 00:02:12.050 ************************************ 00:02:12.050 17:50:21 -- spdk/autobuild.sh@1 -- $ stop_monitor_resources 00:02:12.050 17:50:21 -- pm/common@30 -- $ signal_monitor_resources TERM 00:02:12.050 17:50:21 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:02:12.050 17:50:21 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.050 17:50:21 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:02:12.050 17:50:21 -- pm/common@45 -- $ pid=724021 00:02:12.050 17:50:21 -- pm/common@52 -- $ sudo kill -TERM 724021 00:02:12.050 17:50:21 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.050 17:50:21 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:02:12.050 17:50:21 -- pm/common@45 -- $ pid=724020 00:02:12.050 17:50:21 -- pm/common@52 -- $ sudo kill -TERM 724020 00:02:12.050 17:50:21 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.050 17:50:21 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:02:12.050 17:50:21 -- pm/common@45 -- $ pid=724022 00:02:12.050 17:50:21 -- pm/common@52 -- $ sudo kill -TERM 724022 00:02:12.050 17:50:21 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.050 17:50:21 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:02:12.050 17:50:21 -- pm/common@45 -- $ pid=724023 00:02:12.050 17:50:21 -- pm/common@52 -- $ sudo kill -TERM 724023 00:02:12.309 17:50:21 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:02:12.309 17:50:21 -- nvmf/common.sh@7 -- # uname -s 00:02:12.309 17:50:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:12.309 17:50:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:12.309 17:50:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:12.309 17:50:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:12.309 17:50:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:12.309 17:50:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:12.309 17:50:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:12.309 17:50:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:12.309 17:50:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:12.309 17:50:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:12.309 17:50:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:02:12.309 17:50:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:02:12.309 17:50:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:12.309 17:50:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:12.309 17:50:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:12.309 17:50:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:02:12.309 17:50:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:02:12.309 17:50:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:12.309 17:50:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:12.309 17:50:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:12.309 17:50:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:12.309 17:50:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:12.309 17:50:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:12.309 17:50:21 -- paths/export.sh@5 -- # export PATH 00:02:12.309 17:50:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:12.309 17:50:21 -- nvmf/common.sh@47 -- # : 0 00:02:12.309 17:50:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:02:12.309 17:50:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:02:12.309 17:50:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:02:12.309 17:50:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:12.309 17:50:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:12.309 17:50:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:02:12.309 17:50:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:02:12.309 17:50:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:02:12.309 17:50:21 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:12.309 17:50:21 -- spdk/autotest.sh@32 -- # uname -s 00:02:12.309 17:50:21 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:12.309 17:50:21 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:12.309 17:50:21 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:12.309 17:50:21 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:12.309 17:50:21 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/coredumps 00:02:12.309 17:50:21 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:12.309 17:50:21 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:12.309 17:50:21 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:12.309 17:50:21 -- spdk/autotest.sh@48 -- # udevadm_pid=780550 00:02:12.309 17:50:21 -- spdk/autotest.sh@53 -- # start_monitor_resources 00:02:12.309 17:50:21 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:12.309 17:50:21 -- pm/common@17 -- # local monitor 00:02:12.309 17:50:21 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.309 17:50:21 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=780551 00:02:12.309 17:50:21 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.309 17:50:21 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=780554 00:02:12.309 17:50:21 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.309 17:50:21 -- pm/common@21 -- # date +%s 00:02:12.309 17:50:21 -- pm/common@21 -- # date +%s 00:02:12.309 17:50:21 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=780557 00:02:12.309 17:50:21 -- pm/common@19 -- # for monitor in "${MONITOR_RESOURCES[@]}" 00:02:12.309 17:50:21 -- pm/common@23 -- # MONITOR_RESOURCES_PIDS["$monitor"]=780561 00:02:12.309 17:50:21 -- pm/common@26 -- # sleep 1 00:02:12.309 17:50:21 -- pm/common@21 -- # date +%s 00:02:12.309 17:50:21 -- pm/common@21 -- # date +%s 00:02:12.309 17:50:21 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714146621 00:02:12.309 17:50:21 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714146621 00:02:12.309 17:50:21 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714146621 00:02:12.309 17:50:21 -- pm/common@21 -- # sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autotest.sh.1714146621 00:02:12.309 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714146621_collect-bmc-pm.bmc.pm.log 00:02:12.309 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714146621_collect-vmstat.pm.log 00:02:12.309 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714146621_collect-cpu-temp.pm.log 00:02:12.310 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autotest.sh.1714146621_collect-cpu-load.pm.log 00:02:13.246 17:50:22 -- spdk/autotest.sh@55 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:13.246 17:50:22 -- spdk/autotest.sh@57 -- # timing_enter autotest 00:02:13.246 17:50:22 -- common/autotest_common.sh@720 -- # xtrace_disable 00:02:13.246 17:50:22 -- common/autotest_common.sh@10 -- # set +x 00:02:13.246 17:50:22 -- spdk/autotest.sh@59 -- # create_test_list 00:02:13.246 17:50:22 -- common/autotest_common.sh@744 -- # xtrace_disable 00:02:13.246 17:50:22 -- common/autotest_common.sh@10 -- # set +x 00:02:13.246 17:50:22 -- spdk/autotest.sh@61 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/autotest.sh 00:02:13.504 17:50:22 -- spdk/autotest.sh@61 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:13.504 17:50:22 -- spdk/autotest.sh@61 -- # src=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:13.504 17:50:22 -- spdk/autotest.sh@62 -- # out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:02:13.504 17:50:22 -- spdk/autotest.sh@63 -- # cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:02:13.504 17:50:22 -- spdk/autotest.sh@65 -- # freebsd_update_contigmem_mod 00:02:13.504 17:50:22 -- common/autotest_common.sh@1451 -- # uname 00:02:13.504 17:50:22 -- common/autotest_common.sh@1451 -- # '[' Linux = FreeBSD ']' 00:02:13.504 17:50:22 -- spdk/autotest.sh@66 -- # freebsd_set_maxsock_buf 00:02:13.504 17:50:22 -- common/autotest_common.sh@1471 -- # uname 00:02:13.504 17:50:22 -- common/autotest_common.sh@1471 -- # [[ Linux = FreeBSD ]] 00:02:13.504 17:50:22 -- spdk/autotest.sh@71 -- # grep CC_TYPE mk/cc.mk 00:02:13.504 17:50:22 -- spdk/autotest.sh@71 -- # CC_TYPE=CC_TYPE=gcc 00:02:13.504 17:50:22 -- spdk/autotest.sh@72 -- # hash lcov 00:02:13.504 17:50:22 -- spdk/autotest.sh@72 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:02:13.504 17:50:22 -- spdk/autotest.sh@80 -- # export 'LCOV_OPTS= 00:02:13.504 --rc lcov_branch_coverage=1 00:02:13.504 --rc lcov_function_coverage=1 00:02:13.504 --rc genhtml_branch_coverage=1 00:02:13.504 --rc genhtml_function_coverage=1 00:02:13.504 --rc genhtml_legend=1 00:02:13.504 --rc geninfo_all_blocks=1 00:02:13.504 ' 00:02:13.504 17:50:22 -- spdk/autotest.sh@80 -- # LCOV_OPTS=' 00:02:13.504 --rc lcov_branch_coverage=1 00:02:13.504 --rc lcov_function_coverage=1 00:02:13.504 --rc genhtml_branch_coverage=1 00:02:13.504 --rc genhtml_function_coverage=1 00:02:13.504 --rc genhtml_legend=1 00:02:13.504 --rc geninfo_all_blocks=1 00:02:13.504 ' 00:02:13.504 17:50:22 -- spdk/autotest.sh@81 -- # export 'LCOV=lcov 00:02:13.504 --rc lcov_branch_coverage=1 00:02:13.504 --rc lcov_function_coverage=1 00:02:13.504 --rc genhtml_branch_coverage=1 00:02:13.504 --rc genhtml_function_coverage=1 00:02:13.504 --rc genhtml_legend=1 00:02:13.504 --rc geninfo_all_blocks=1 00:02:13.504 --no-external' 00:02:13.504 17:50:22 -- spdk/autotest.sh@81 -- # LCOV='lcov 00:02:13.504 --rc lcov_branch_coverage=1 00:02:13.504 --rc lcov_function_coverage=1 00:02:13.504 --rc genhtml_branch_coverage=1 00:02:13.504 --rc genhtml_function_coverage=1 00:02:13.504 --rc genhtml_legend=1 00:02:13.504 --rc geninfo_all_blocks=1 00:02:13.504 --no-external' 00:02:13.504 17:50:22 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -v 00:02:13.504 lcov: LCOV version 1.14 00:02:13.504 17:50:22 -- spdk/autotest.sh@85 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -i -t Baseline -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/accel_module.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/assert.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/barrier.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/base64.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_zone.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bdev_module.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_pool.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/bit_array.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob_bdev.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs_bdev.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blobfs.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/blob.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/conf.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/config.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/cpuset.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc16.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc32.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/crc64.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dma.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/dif.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env_dpdk.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/endian.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/env.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/event.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/fd_group.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ftl.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/file.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/gpt_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/hexlify.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/histogram_data.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/idxd_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/init.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ioat_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/iscsi_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/jsonrpc.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/json.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/keyring_module.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/likely.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/log.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/lvol.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/memory.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nbd.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/mmio.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/notify.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_intel.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_ocssd_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvme_zns.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_cmd.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_fc_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/opal_spec.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/nvmf_transport.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pci_ids.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/pipe.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/rpc.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/queue.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scheduler.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/reduce.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno:no functions found 00:02:20.086 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi.gcno 00:02:20.086 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/scsi_spec.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/sock.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/stdinc.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/string.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/thread.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace_parser.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/trace.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/tree.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/uuid.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/util.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/ublk.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/version.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_pci.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vfio_user_spec.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vhost.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/vmd.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/zipf.gcno 00:02:20.087 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno:no functions found 00:02:20.087 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/cpp_headers/xor.gcno 00:02:22.609 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno:no functions found 00:02:22.609 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/nvme/nvme_stubs.gcno 00:02:30.737 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:30.737 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:30.737 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:30.737 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:30.737 /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:30.737 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:37.305 17:50:45 -- spdk/autotest.sh@89 -- # timing_enter pre_cleanup 00:02:37.305 17:50:45 -- common/autotest_common.sh@720 -- # xtrace_disable 00:02:37.305 17:50:45 -- common/autotest_common.sh@10 -- # set +x 00:02:37.305 17:50:45 -- spdk/autotest.sh@91 -- # rm -f 00:02:37.305 17:50:45 -- spdk/autotest.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:39.835 0000:5f:00.0 (8086 0a54): Already using the nvme driver 00:02:39.835 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:39.835 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:40.094 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:40.353 17:50:49 -- spdk/autotest.sh@96 -- # get_zoned_devs 00:02:40.353 17:50:49 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:02:40.353 17:50:49 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:02:40.353 17:50:49 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:02:40.353 17:50:49 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:02:40.353 17:50:49 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:02:40.353 17:50:49 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:02:40.353 17:50:49 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:40.353 17:50:49 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:02:40.353 17:50:49 -- spdk/autotest.sh@98 -- # (( 0 > 0 )) 00:02:40.353 17:50:49 -- spdk/autotest.sh@110 -- # for dev in /dev/nvme*n!(*p*) 00:02:40.353 17:50:49 -- spdk/autotest.sh@112 -- # [[ -z '' ]] 00:02:40.353 17:50:49 -- spdk/autotest.sh@113 -- # block_in_use /dev/nvme0n1 00:02:40.353 17:50:49 -- scripts/common.sh@378 -- # local block=/dev/nvme0n1 pt 00:02:40.353 17:50:49 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:40.353 No valid GPT data, bailing 00:02:40.353 17:50:49 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:40.353 17:50:49 -- scripts/common.sh@391 -- # pt= 00:02:40.353 17:50:49 -- scripts/common.sh@392 -- # return 1 00:02:40.353 17:50:49 -- spdk/autotest.sh@114 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:40.353 1+0 records in 00:02:40.353 1+0 records out 00:02:40.353 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632392 s, 166 MB/s 00:02:40.353 17:50:49 -- spdk/autotest.sh@118 -- # sync 00:02:40.353 17:50:49 -- spdk/autotest.sh@120 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:40.353 17:50:49 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:40.353 17:50:49 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:45.622 17:50:54 -- spdk/autotest.sh@124 -- # uname -s 00:02:45.622 17:50:54 -- spdk/autotest.sh@124 -- # '[' Linux = Linux ']' 00:02:45.622 17:50:54 -- spdk/autotest.sh@125 -- # run_test setup.sh /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:45.622 17:50:54 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:45.622 17:50:54 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:45.622 17:50:54 -- common/autotest_common.sh@10 -- # set +x 00:02:45.622 ************************************ 00:02:45.622 START TEST setup.sh 00:02:45.622 ************************************ 00:02:45.622 17:50:54 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/test-setup.sh 00:02:45.622 * Looking for test storage... 00:02:45.622 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:45.622 17:50:54 -- setup/test-setup.sh@10 -- # uname -s 00:02:45.622 17:50:54 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:45.622 17:50:54 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:45.622 17:50:54 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:45.622 17:50:54 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:45.622 17:50:54 -- common/autotest_common.sh@10 -- # set +x 00:02:45.622 ************************************ 00:02:45.622 START TEST acl 00:02:45.622 ************************************ 00:02:45.622 17:50:54 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/acl.sh 00:02:45.622 * Looking for test storage... 00:02:45.622 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:02:45.622 17:50:54 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:45.622 17:50:54 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:02:45.622 17:50:54 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:02:45.622 17:50:54 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:02:45.622 17:50:54 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:02:45.622 17:50:54 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:02:45.622 17:50:54 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:02:45.622 17:50:54 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:45.622 17:50:54 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:02:45.622 17:50:54 -- setup/acl.sh@12 -- # devs=() 00:02:45.622 17:50:54 -- setup/acl.sh@12 -- # declare -a devs 00:02:45.622 17:50:54 -- setup/acl.sh@13 -- # drivers=() 00:02:45.622 17:50:54 -- setup/acl.sh@13 -- # declare -A drivers 00:02:45.622 17:50:54 -- setup/acl.sh@51 -- # setup reset 00:02:45.622 17:50:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:45.622 17:50:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:02:48.906 17:50:58 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:48.906 17:50:58 -- setup/acl.sh@16 -- # local dev driver 00:02:48.906 17:50:58 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:48.906 17:50:58 -- setup/acl.sh@15 -- # setup output status 00:02:48.906 17:50:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:48.906 17:50:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:02:52.191 Hugepages 00:02:52.191 node hugesize free / total 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 00:02:52.191 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.191 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.191 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.191 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:00 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:00 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:00 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:5f:00.0 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:52.192 17:51:01 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.192 17:51:01 -- setup/acl.sh@20 -- # continue 00:02:52.192 17:51:01 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.192 17:51:01 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:52.192 17:51:01 -- setup/acl.sh@54 -- # run_test denied denied 00:02:52.192 17:51:01 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:02:52.192 17:51:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:02:52.192 17:51:01 -- common/autotest_common.sh@10 -- # set +x 00:02:52.192 ************************************ 00:02:52.192 START TEST denied 00:02:52.192 ************************************ 00:02:52.192 17:51:01 -- common/autotest_common.sh@1121 -- # denied 00:02:52.192 17:51:01 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5f:00.0' 00:02:52.192 17:51:01 -- setup/acl.sh@38 -- # setup output config 00:02:52.192 17:51:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:52.192 17:51:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:02:52.192 17:51:01 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5f:00.0' 00:02:55.479 0000:5f:00.0 (8086 0a54): Skipping denied controller at 0000:5f:00.0 00:02:55.479 17:51:04 -- setup/acl.sh@40 -- # verify 0000:5f:00.0 00:02:55.479 17:51:04 -- setup/acl.sh@28 -- # local dev driver 00:02:55.479 17:51:04 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:55.479 17:51:04 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5f:00.0 ]] 00:02:55.479 17:51:04 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5f:00.0/driver 00:02:55.479 17:51:04 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:55.479 17:51:04 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:55.479 17:51:04 -- setup/acl.sh@41 -- # setup reset 00:02:55.479 17:51:04 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:55.479 17:51:04 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:00.747 00:03:00.747 real 0m7.689s 00:03:00.747 user 0m2.398s 00:03:00.747 sys 0m4.641s 00:03:00.747 17:51:08 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:00.747 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:03:00.747 ************************************ 00:03:00.747 END TEST denied 00:03:00.747 ************************************ 00:03:00.747 17:51:08 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:00.747 17:51:08 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:00.747 17:51:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:00.747 17:51:08 -- common/autotest_common.sh@10 -- # set +x 00:03:00.747 ************************************ 00:03:00.747 START TEST allowed 00:03:00.747 ************************************ 00:03:00.747 17:51:09 -- common/autotest_common.sh@1121 -- # allowed 00:03:00.747 17:51:09 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5f:00.0 00:03:00.747 17:51:09 -- setup/acl.sh@46 -- # grep -E '0000:5f:00.0 .*: nvme -> .*' 00:03:00.747 17:51:09 -- setup/acl.sh@45 -- # setup output config 00:03:00.747 17:51:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:00.747 17:51:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:07.308 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:03:07.308 17:51:15 -- setup/acl.sh@47 -- # verify 00:03:07.308 17:51:15 -- setup/acl.sh@28 -- # local dev driver 00:03:07.308 17:51:15 -- setup/acl.sh@48 -- # setup reset 00:03:07.308 17:51:15 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:07.308 17:51:15 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.838 00:03:09.838 real 0m9.761s 00:03:09.838 user 0m2.238s 00:03:09.838 sys 0m4.318s 00:03:09.838 17:51:18 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:09.838 17:51:18 -- common/autotest_common.sh@10 -- # set +x 00:03:09.838 ************************************ 00:03:09.838 END TEST allowed 00:03:09.838 ************************************ 00:03:09.838 00:03:09.838 real 0m24.461s 00:03:09.838 user 0m7.122s 00:03:09.838 sys 0m13.658s 00:03:09.839 17:51:18 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:09.839 17:51:18 -- common/autotest_common.sh@10 -- # set +x 00:03:09.839 ************************************ 00:03:09.839 END TEST acl 00:03:09.839 ************************************ 00:03:09.839 17:51:18 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:09.839 17:51:18 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:09.839 17:51:18 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:09.839 17:51:18 -- common/autotest_common.sh@10 -- # set +x 00:03:10.099 ************************************ 00:03:10.099 START TEST hugepages 00:03:10.099 ************************************ 00:03:10.099 17:51:19 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/hugepages.sh 00:03:10.099 * Looking for test storage... 00:03:10.099 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:10.099 17:51:19 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:10.099 17:51:19 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:10.099 17:51:19 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:10.099 17:51:19 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:10.099 17:51:19 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:10.099 17:51:19 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:10.099 17:51:19 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:10.099 17:51:19 -- setup/common.sh@18 -- # local node= 00:03:10.099 17:51:19 -- setup/common.sh@19 -- # local var val 00:03:10.099 17:51:19 -- setup/common.sh@20 -- # local mem_f mem 00:03:10.099 17:51:19 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:10.099 17:51:19 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:10.099 17:51:19 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:10.099 17:51:19 -- setup/common.sh@28 -- # mapfile -t mem 00:03:10.099 17:51:19 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.099 17:51:19 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 44438748 kB' 'MemAvailable: 48017848 kB' 'Buffers: 5092 kB' 'Cached: 9191740 kB' 'SwapCached: 0 kB' 'Active: 6205284 kB' 'Inactive: 3421772 kB' 'Active(anon): 5646576 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 434060 kB' 'Mapped: 161232 kB' 'Shmem: 5216352 kB' 'KReclaimable: 191124 kB' 'Slab: 579532 kB' 'SReclaimable: 191124 kB' 'SUnreclaim: 388408 kB' 'KernelStack: 16736 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36439252 kB' 'Committed_AS: 6856184 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203124 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.099 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.099 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.100 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.100 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # continue 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # IFS=': ' 00:03:10.101 17:51:19 -- setup/common.sh@31 -- # read -r var val _ 00:03:10.101 17:51:19 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:10.101 17:51:19 -- setup/common.sh@33 -- # echo 2048 00:03:10.101 17:51:19 -- setup/common.sh@33 -- # return 0 00:03:10.101 17:51:19 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:10.101 17:51:19 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:10.101 17:51:19 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:10.101 17:51:19 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:10.101 17:51:19 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:10.101 17:51:19 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:10.101 17:51:19 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:10.101 17:51:19 -- setup/hugepages.sh@207 -- # get_nodes 00:03:10.101 17:51:19 -- setup/hugepages.sh@27 -- # local node 00:03:10.101 17:51:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.101 17:51:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:10.101 17:51:19 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:10.101 17:51:19 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:10.101 17:51:19 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:10.101 17:51:19 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:10.101 17:51:19 -- setup/hugepages.sh@208 -- # clear_hp 00:03:10.101 17:51:19 -- setup/hugepages.sh@37 -- # local node hp 00:03:10.101 17:51:19 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:10.101 17:51:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:10.101 17:51:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:10.101 17:51:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:10.101 17:51:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:10.360 17:51:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:10.360 17:51:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:10.360 17:51:19 -- setup/hugepages.sh@41 -- # echo 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:10.360 17:51:19 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:10.360 17:51:19 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:10.360 17:51:19 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:10.360 17:51:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:10.360 17:51:19 -- common/autotest_common.sh@10 -- # set +x 00:03:10.360 ************************************ 00:03:10.360 START TEST default_setup 00:03:10.360 ************************************ 00:03:10.360 17:51:19 -- common/autotest_common.sh@1121 -- # default_setup 00:03:10.360 17:51:19 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:10.360 17:51:19 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:10.360 17:51:19 -- setup/hugepages.sh@51 -- # shift 00:03:10.360 17:51:19 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:10.360 17:51:19 -- setup/hugepages.sh@52 -- # local node_ids 00:03:10.360 17:51:19 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:10.360 17:51:19 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:10.360 17:51:19 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:10.360 17:51:19 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:10.360 17:51:19 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:10.360 17:51:19 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:10.360 17:51:19 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:10.360 17:51:19 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:10.360 17:51:19 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:10.360 17:51:19 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:10.360 17:51:19 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:10.360 17:51:19 -- setup/hugepages.sh@73 -- # return 0 00:03:10.360 17:51:19 -- setup/hugepages.sh@137 -- # setup output 00:03:10.360 17:51:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:10.360 17:51:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:13.643 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:13.643 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:16.960 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:03:16.960 17:51:26 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:16.960 17:51:26 -- setup/hugepages.sh@89 -- # local node 00:03:16.960 17:51:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:16.960 17:51:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:16.960 17:51:26 -- setup/hugepages.sh@92 -- # local surp 00:03:16.960 17:51:26 -- setup/hugepages.sh@93 -- # local resv 00:03:16.960 17:51:26 -- setup/hugepages.sh@94 -- # local anon 00:03:16.960 17:51:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:16.960 17:51:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:16.960 17:51:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:16.960 17:51:26 -- setup/common.sh@18 -- # local node= 00:03:16.960 17:51:26 -- setup/common.sh@19 -- # local var val 00:03:16.960 17:51:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.960 17:51:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.960 17:51:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.960 17:51:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.960 17:51:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.960 17:51:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46626096 kB' 'MemAvailable: 50205044 kB' 'Buffers: 5092 kB' 'Cached: 9191860 kB' 'SwapCached: 0 kB' 'Active: 6220640 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661932 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448816 kB' 'Mapped: 161188 kB' 'Shmem: 5216472 kB' 'KReclaimable: 190820 kB' 'Slab: 578112 kB' 'SReclaimable: 190820 kB' 'SUnreclaim: 387292 kB' 'KernelStack: 16848 kB' 'PageTables: 9200 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6870220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203140 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.960 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.960 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:16.961 17:51:26 -- setup/common.sh@33 -- # echo 0 00:03:16.961 17:51:26 -- setup/common.sh@33 -- # return 0 00:03:16.961 17:51:26 -- setup/hugepages.sh@97 -- # anon=0 00:03:16.961 17:51:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:16.961 17:51:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:16.961 17:51:26 -- setup/common.sh@18 -- # local node= 00:03:16.961 17:51:26 -- setup/common.sh@19 -- # local var val 00:03:16.961 17:51:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.961 17:51:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.961 17:51:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.961 17:51:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.961 17:51:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.961 17:51:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46627068 kB' 'MemAvailable: 50206008 kB' 'Buffers: 5092 kB' 'Cached: 9191864 kB' 'SwapCached: 0 kB' 'Active: 6220124 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661416 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448808 kB' 'Mapped: 161164 kB' 'Shmem: 5216476 kB' 'KReclaimable: 190804 kB' 'Slab: 578272 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387468 kB' 'KernelStack: 17056 kB' 'PageTables: 9464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6868844 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203076 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.961 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.961 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:16.962 17:51:26 -- setup/common.sh@33 -- # echo 0 00:03:16.962 17:51:26 -- setup/common.sh@33 -- # return 0 00:03:16.962 17:51:26 -- setup/hugepages.sh@99 -- # surp=0 00:03:16.962 17:51:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:16.962 17:51:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:16.962 17:51:26 -- setup/common.sh@18 -- # local node= 00:03:16.962 17:51:26 -- setup/common.sh@19 -- # local var val 00:03:16.962 17:51:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.962 17:51:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.962 17:51:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.962 17:51:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.962 17:51:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.962 17:51:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46624540 kB' 'MemAvailable: 50203480 kB' 'Buffers: 5092 kB' 'Cached: 9191876 kB' 'SwapCached: 0 kB' 'Active: 6221080 kB' 'Inactive: 3421772 kB' 'Active(anon): 5662372 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449128 kB' 'Mapped: 161172 kB' 'Shmem: 5216488 kB' 'KReclaimable: 190804 kB' 'Slab: 578208 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387404 kB' 'KernelStack: 17024 kB' 'PageTables: 9684 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6870244 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203204 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.962 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.962 17:51:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.963 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.963 17:51:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:16.964 17:51:26 -- setup/common.sh@33 -- # echo 0 00:03:16.964 17:51:26 -- setup/common.sh@33 -- # return 0 00:03:16.964 17:51:26 -- setup/hugepages.sh@100 -- # resv=0 00:03:16.964 17:51:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:16.964 nr_hugepages=1024 00:03:16.964 17:51:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:16.964 resv_hugepages=0 00:03:16.964 17:51:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:16.964 surplus_hugepages=0 00:03:16.964 17:51:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:16.964 anon_hugepages=0 00:03:16.964 17:51:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:16.964 17:51:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:16.964 17:51:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:16.964 17:51:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:16.964 17:51:26 -- setup/common.sh@18 -- # local node= 00:03:16.964 17:51:26 -- setup/common.sh@19 -- # local var val 00:03:16.964 17:51:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:16.964 17:51:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:16.964 17:51:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:16.964 17:51:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:16.964 17:51:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:16.964 17:51:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46622540 kB' 'MemAvailable: 50201480 kB' 'Buffers: 5092 kB' 'Cached: 9191892 kB' 'SwapCached: 0 kB' 'Active: 6222028 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663320 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450064 kB' 'Mapped: 161172 kB' 'Shmem: 5216504 kB' 'KReclaimable: 190804 kB' 'Slab: 578208 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387404 kB' 'KernelStack: 17360 kB' 'PageTables: 10560 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6870260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203172 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.964 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.964 17:51:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:16.965 17:51:26 -- setup/common.sh@32 -- # continue 00:03:16.965 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.225 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.225 17:51:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.226 17:51:26 -- setup/common.sh@33 -- # echo 1024 00:03:17.226 17:51:26 -- setup/common.sh@33 -- # return 0 00:03:17.226 17:51:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:17.226 17:51:26 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.226 17:51:26 -- setup/hugepages.sh@27 -- # local node 00:03:17.226 17:51:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.226 17:51:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:17.226 17:51:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.226 17:51:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:17.226 17:51:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.226 17:51:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.226 17:51:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.226 17:51:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.226 17:51:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.226 17:51:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.226 17:51:26 -- setup/common.sh@18 -- # local node=0 00:03:17.226 17:51:26 -- setup/common.sh@19 -- # local var val 00:03:17.226 17:51:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.226 17:51:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.226 17:51:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.226 17:51:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.226 17:51:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.226 17:51:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27058728 kB' 'MemUsed: 5528336 kB' 'SwapCached: 0 kB' 'Active: 2114736 kB' 'Inactive: 77644 kB' 'Active(anon): 1733000 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998464 kB' 'Mapped: 64276 kB' 'AnonPages: 197096 kB' 'Shmem: 1539084 kB' 'KernelStack: 9992 kB' 'PageTables: 5300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360376 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 238008 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.226 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.226 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # continue 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.227 17:51:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.227 17:51:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.227 17:51:26 -- setup/common.sh@33 -- # echo 0 00:03:17.227 17:51:26 -- setup/common.sh@33 -- # return 0 00:03:17.227 17:51:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.227 17:51:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.227 17:51:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.227 17:51:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.227 17:51:26 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:17.227 node0=1024 expecting 1024 00:03:17.227 17:51:26 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:17.227 00:03:17.227 real 0m6.725s 00:03:17.227 user 0m1.394s 00:03:17.227 sys 0m2.254s 00:03:17.227 17:51:26 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:17.227 17:51:26 -- common/autotest_common.sh@10 -- # set +x 00:03:17.227 ************************************ 00:03:17.227 END TEST default_setup 00:03:17.227 ************************************ 00:03:17.227 17:51:26 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:17.227 17:51:26 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:17.227 17:51:26 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:17.227 17:51:26 -- common/autotest_common.sh@10 -- # set +x 00:03:17.227 ************************************ 00:03:17.227 START TEST per_node_1G_alloc 00:03:17.227 ************************************ 00:03:17.227 17:51:26 -- common/autotest_common.sh@1121 -- # per_node_1G_alloc 00:03:17.227 17:51:26 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:17.227 17:51:26 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:17.227 17:51:26 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:17.227 17:51:26 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:17.227 17:51:26 -- setup/hugepages.sh@51 -- # shift 00:03:17.227 17:51:26 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:17.227 17:51:26 -- setup/hugepages.sh@52 -- # local node_ids 00:03:17.227 17:51:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.227 17:51:26 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:17.227 17:51:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:17.227 17:51:26 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:17.227 17:51:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.227 17:51:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:17.227 17:51:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.227 17:51:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.227 17:51:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.227 17:51:26 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:17.227 17:51:26 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:17.227 17:51:26 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:17.227 17:51:26 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:17.227 17:51:26 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:17.227 17:51:26 -- setup/hugepages.sh@73 -- # return 0 00:03:17.227 17:51:26 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:17.227 17:51:26 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:17.227 17:51:26 -- setup/hugepages.sh@146 -- # setup output 00:03:17.227 17:51:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.227 17:51:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:19.757 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:19.757 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:19.757 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:19.757 17:51:28 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:19.757 17:51:28 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:19.757 17:51:28 -- setup/hugepages.sh@89 -- # local node 00:03:19.757 17:51:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:19.757 17:51:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:19.757 17:51:28 -- setup/hugepages.sh@92 -- # local surp 00:03:19.757 17:51:28 -- setup/hugepages.sh@93 -- # local resv 00:03:19.757 17:51:28 -- setup/hugepages.sh@94 -- # local anon 00:03:19.757 17:51:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:19.757 17:51:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:19.757 17:51:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:19.757 17:51:28 -- setup/common.sh@18 -- # local node= 00:03:19.757 17:51:28 -- setup/common.sh@19 -- # local var val 00:03:19.757 17:51:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.757 17:51:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.757 17:51:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.757 17:51:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.757 17:51:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.757 17:51:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46618328 kB' 'MemAvailable: 50197268 kB' 'Buffers: 5092 kB' 'Cached: 9191960 kB' 'SwapCached: 0 kB' 'Active: 6220644 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661936 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448240 kB' 'Mapped: 161336 kB' 'Shmem: 5216572 kB' 'KReclaimable: 190804 kB' 'Slab: 578392 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387588 kB' 'KernelStack: 16720 kB' 'PageTables: 8160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6867620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.757 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.757 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:19.758 17:51:28 -- setup/common.sh@33 -- # echo 0 00:03:19.758 17:51:28 -- setup/common.sh@33 -- # return 0 00:03:19.758 17:51:28 -- setup/hugepages.sh@97 -- # anon=0 00:03:19.758 17:51:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:19.758 17:51:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:19.758 17:51:28 -- setup/common.sh@18 -- # local node= 00:03:19.758 17:51:28 -- setup/common.sh@19 -- # local var val 00:03:19.758 17:51:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:19.758 17:51:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:19.758 17:51:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:19.758 17:51:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:19.758 17:51:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:19.758 17:51:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46618976 kB' 'MemAvailable: 50197916 kB' 'Buffers: 5092 kB' 'Cached: 9191972 kB' 'SwapCached: 0 kB' 'Active: 6219360 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660652 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446936 kB' 'Mapped: 161272 kB' 'Shmem: 5216584 kB' 'KReclaimable: 190804 kB' 'Slab: 578392 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387588 kB' 'KernelStack: 16544 kB' 'PageTables: 7760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6868004 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.758 17:51:28 -- setup/common.sh@32 -- # continue 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:19.758 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:19.759 17:51:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:19.759 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.021 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.021 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.022 17:51:28 -- setup/common.sh@33 -- # echo 0 00:03:20.022 17:51:28 -- setup/common.sh@33 -- # return 0 00:03:20.022 17:51:28 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.022 17:51:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.022 17:51:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.022 17:51:28 -- setup/common.sh@18 -- # local node= 00:03:20.022 17:51:28 -- setup/common.sh@19 -- # local var val 00:03:20.022 17:51:28 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.022 17:51:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.022 17:51:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.022 17:51:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.022 17:51:28 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.022 17:51:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.022 17:51:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46618352 kB' 'MemAvailable: 50197292 kB' 'Buffers: 5092 kB' 'Cached: 9191980 kB' 'SwapCached: 0 kB' 'Active: 6219108 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660400 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447112 kB' 'Mapped: 161196 kB' 'Shmem: 5216592 kB' 'KReclaimable: 190804 kB' 'Slab: 578384 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387580 kB' 'KernelStack: 16480 kB' 'PageTables: 7560 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6868020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202980 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.022 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.022 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:28 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.023 17:51:28 -- setup/common.sh@33 -- # echo 0 00:03:20.023 17:51:28 -- setup/common.sh@33 -- # return 0 00:03:20.023 17:51:28 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.023 17:51:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:20.023 nr_hugepages=1024 00:03:20.023 17:51:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.023 resv_hugepages=0 00:03:20.023 17:51:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.023 surplus_hugepages=0 00:03:20.023 17:51:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.023 anon_hugepages=0 00:03:20.023 17:51:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.023 17:51:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:20.023 17:51:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.023 17:51:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.023 17:51:29 -- setup/common.sh@18 -- # local node= 00:03:20.023 17:51:29 -- setup/common.sh@19 -- # local var val 00:03:20.023 17:51:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.023 17:51:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.023 17:51:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.023 17:51:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.023 17:51:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.023 17:51:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46618352 kB' 'MemAvailable: 50197292 kB' 'Buffers: 5092 kB' 'Cached: 9191992 kB' 'SwapCached: 0 kB' 'Active: 6218904 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660196 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446900 kB' 'Mapped: 161196 kB' 'Shmem: 5216604 kB' 'KReclaimable: 190804 kB' 'Slab: 578384 kB' 'SReclaimable: 190804 kB' 'SUnreclaim: 387580 kB' 'KernelStack: 16480 kB' 'PageTables: 7560 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6868032 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.023 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.023 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.024 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.024 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.024 17:51:29 -- setup/common.sh@33 -- # echo 1024 00:03:20.024 17:51:29 -- setup/common.sh@33 -- # return 0 00:03:20.024 17:51:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:20.024 17:51:29 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.024 17:51:29 -- setup/hugepages.sh@27 -- # local node 00:03:20.024 17:51:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.024 17:51:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.024 17:51:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.024 17:51:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.024 17:51:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.025 17:51:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.025 17:51:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.025 17:51:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.025 17:51:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.025 17:51:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.025 17:51:29 -- setup/common.sh@18 -- # local node=0 00:03:20.025 17:51:29 -- setup/common.sh@19 -- # local var val 00:03:20.025 17:51:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.025 17:51:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.025 17:51:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.025 17:51:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.025 17:51:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.025 17:51:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28104924 kB' 'MemUsed: 4482140 kB' 'SwapCached: 0 kB' 'Active: 2113576 kB' 'Inactive: 77644 kB' 'Active(anon): 1731840 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998520 kB' 'Mapped: 64276 kB' 'AnonPages: 195976 kB' 'Shmem: 1539140 kB' 'KernelStack: 9640 kB' 'PageTables: 4084 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360360 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 237992 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.025 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.025 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@33 -- # echo 0 00:03:20.026 17:51:29 -- setup/common.sh@33 -- # return 0 00:03:20.026 17:51:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.026 17:51:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.026 17:51:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.026 17:51:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.026 17:51:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.026 17:51:29 -- setup/common.sh@18 -- # local node=1 00:03:20.026 17:51:29 -- setup/common.sh@19 -- # local var val 00:03:20.026 17:51:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.026 17:51:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.026 17:51:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.026 17:51:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.026 17:51:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.026 17:51:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 18513428 kB' 'MemUsed: 9195112 kB' 'SwapCached: 0 kB' 'Active: 4105724 kB' 'Inactive: 3344128 kB' 'Active(anon): 3928752 kB' 'Inactive(anon): 0 kB' 'Active(file): 176972 kB' 'Inactive(file): 3344128 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7198584 kB' 'Mapped: 96920 kB' 'AnonPages: 251340 kB' 'Shmem: 3677484 kB' 'KernelStack: 6856 kB' 'PageTables: 3528 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68436 kB' 'Slab: 218024 kB' 'SReclaimable: 68436 kB' 'SUnreclaim: 149588 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.026 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.026 17:51:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # continue 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.027 17:51:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.027 17:51:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.027 17:51:29 -- setup/common.sh@33 -- # echo 0 00:03:20.027 17:51:29 -- setup/common.sh@33 -- # return 0 00:03:20.027 17:51:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.027 17:51:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.027 17:51:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.027 17:51:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.027 17:51:29 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.027 node0=512 expecting 512 00:03:20.027 17:51:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.027 17:51:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.027 17:51:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.027 17:51:29 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:20.027 node1=512 expecting 512 00:03:20.027 17:51:29 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:20.027 00:03:20.027 real 0m2.666s 00:03:20.027 user 0m0.930s 00:03:20.027 sys 0m1.723s 00:03:20.027 17:51:29 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:20.027 17:51:29 -- common/autotest_common.sh@10 -- # set +x 00:03:20.027 ************************************ 00:03:20.027 END TEST per_node_1G_alloc 00:03:20.027 ************************************ 00:03:20.027 17:51:29 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:20.027 17:51:29 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:20.027 17:51:29 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:20.027 17:51:29 -- common/autotest_common.sh@10 -- # set +x 00:03:20.285 ************************************ 00:03:20.285 START TEST even_2G_alloc 00:03:20.285 ************************************ 00:03:20.285 17:51:29 -- common/autotest_common.sh@1121 -- # even_2G_alloc 00:03:20.285 17:51:29 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:20.286 17:51:29 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.286 17:51:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.286 17:51:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:20.286 17:51:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:20.286 17:51:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.286 17:51:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.286 17:51:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.286 17:51:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.286 17:51:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.286 17:51:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:20.286 17:51:29 -- setup/hugepages.sh@83 -- # : 512 00:03:20.286 17:51:29 -- setup/hugepages.sh@84 -- # : 1 00:03:20.286 17:51:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:20.286 17:51:29 -- setup/hugepages.sh@83 -- # : 0 00:03:20.286 17:51:29 -- setup/hugepages.sh@84 -- # : 0 00:03:20.286 17:51:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:20.286 17:51:29 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:20.286 17:51:29 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:20.286 17:51:29 -- setup/hugepages.sh@153 -- # setup output 00:03:20.286 17:51:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.286 17:51:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:22.817 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:22.817 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:22.817 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:23.078 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:23.078 17:51:32 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:23.078 17:51:32 -- setup/hugepages.sh@89 -- # local node 00:03:23.078 17:51:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.078 17:51:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.078 17:51:32 -- setup/hugepages.sh@92 -- # local surp 00:03:23.078 17:51:32 -- setup/hugepages.sh@93 -- # local resv 00:03:23.078 17:51:32 -- setup/hugepages.sh@94 -- # local anon 00:03:23.078 17:51:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.078 17:51:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.078 17:51:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.078 17:51:32 -- setup/common.sh@18 -- # local node= 00:03:23.078 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.078 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.078 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.078 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.078 17:51:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.078 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.078 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.078 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.078 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46627640 kB' 'MemAvailable: 50206576 kB' 'Buffers: 5092 kB' 'Cached: 9192072 kB' 'SwapCached: 0 kB' 'Active: 6219348 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660640 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446708 kB' 'Mapped: 160404 kB' 'Shmem: 5216684 kB' 'KReclaimable: 190796 kB' 'Slab: 577572 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 386776 kB' 'KernelStack: 16368 kB' 'PageTables: 7160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6861060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202964 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.079 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.079 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.080 17:51:32 -- setup/common.sh@33 -- # echo 0 00:03:23.080 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.080 17:51:32 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.080 17:51:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.080 17:51:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.080 17:51:32 -- setup/common.sh@18 -- # local node= 00:03:23.080 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.080 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.080 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.080 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.080 17:51:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.080 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.080 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46630820 kB' 'MemAvailable: 50209756 kB' 'Buffers: 5092 kB' 'Cached: 9192076 kB' 'SwapCached: 0 kB' 'Active: 6219668 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660960 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447088 kB' 'Mapped: 160404 kB' 'Shmem: 5216688 kB' 'KReclaimable: 190796 kB' 'Slab: 577540 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 386744 kB' 'KernelStack: 16368 kB' 'PageTables: 7140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6861072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202932 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.080 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.080 17:51:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.081 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.081 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.082 17:51:32 -- setup/common.sh@33 -- # echo 0 00:03:23.082 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.082 17:51:32 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.082 17:51:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.082 17:51:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.082 17:51:32 -- setup/common.sh@18 -- # local node= 00:03:23.082 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.082 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.082 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.082 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.082 17:51:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.082 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.082 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46631224 kB' 'MemAvailable: 50210160 kB' 'Buffers: 5092 kB' 'Cached: 9192092 kB' 'SwapCached: 0 kB' 'Active: 6219100 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660392 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446964 kB' 'Mapped: 160320 kB' 'Shmem: 5216704 kB' 'KReclaimable: 190796 kB' 'Slab: 577548 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 386752 kB' 'KernelStack: 16432 kB' 'PageTables: 7368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6861588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202948 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.082 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.082 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.083 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.083 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.344 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.344 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.345 17:51:32 -- setup/common.sh@33 -- # echo 0 00:03:23.345 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.345 17:51:32 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.345 17:51:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.345 nr_hugepages=1024 00:03:23.345 17:51:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.345 resv_hugepages=0 00:03:23.345 17:51:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.345 surplus_hugepages=0 00:03:23.345 17:51:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.345 anon_hugepages=0 00:03:23.345 17:51:32 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.345 17:51:32 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.345 17:51:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.345 17:51:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.345 17:51:32 -- setup/common.sh@18 -- # local node= 00:03:23.345 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.345 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.345 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.345 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.345 17:51:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.345 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.345 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46631224 kB' 'MemAvailable: 50210160 kB' 'Buffers: 5092 kB' 'Cached: 9192108 kB' 'SwapCached: 0 kB' 'Active: 6218832 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660124 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446720 kB' 'Mapped: 160320 kB' 'Shmem: 5216720 kB' 'KReclaimable: 190796 kB' 'Slab: 577548 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 386752 kB' 'KernelStack: 16448 kB' 'PageTables: 7400 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6861600 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202964 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.345 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.345 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.346 17:51:32 -- setup/common.sh@33 -- # echo 1024 00:03:23.346 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.346 17:51:32 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.346 17:51:32 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.346 17:51:32 -- setup/hugepages.sh@27 -- # local node 00:03:23.346 17:51:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.346 17:51:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.346 17:51:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.346 17:51:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:23.346 17:51:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.346 17:51:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.346 17:51:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.346 17:51:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.346 17:51:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.346 17:51:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.346 17:51:32 -- setup/common.sh@18 -- # local node=0 00:03:23.346 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.346 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.346 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.346 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.346 17:51:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.346 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.346 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28117256 kB' 'MemUsed: 4469808 kB' 'SwapCached: 0 kB' 'Active: 2112876 kB' 'Inactive: 77644 kB' 'Active(anon): 1731140 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998600 kB' 'Mapped: 63380 kB' 'AnonPages: 195120 kB' 'Shmem: 1539220 kB' 'KernelStack: 9560 kB' 'PageTables: 3836 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 359936 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 237568 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.346 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.346 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@33 -- # echo 0 00:03:23.347 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.347 17:51:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.347 17:51:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.347 17:51:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.347 17:51:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:23.347 17:51:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.347 17:51:32 -- setup/common.sh@18 -- # local node=1 00:03:23.347 17:51:32 -- setup/common.sh@19 -- # local var val 00:03:23.347 17:51:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.347 17:51:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.347 17:51:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:23.347 17:51:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:23.347 17:51:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.347 17:51:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 18513968 kB' 'MemUsed: 9194572 kB' 'SwapCached: 0 kB' 'Active: 4106280 kB' 'Inactive: 3344128 kB' 'Active(anon): 3929308 kB' 'Inactive(anon): 0 kB' 'Active(file): 176972 kB' 'Inactive(file): 3344128 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7198616 kB' 'Mapped: 96940 kB' 'AnonPages: 251944 kB' 'Shmem: 3677516 kB' 'KernelStack: 6904 kB' 'PageTables: 3616 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68428 kB' 'Slab: 217612 kB' 'SReclaimable: 68428 kB' 'SUnreclaim: 149184 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.347 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # continue 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 17:51:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 17:51:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 17:51:32 -- setup/common.sh@33 -- # echo 0 00:03:23.348 17:51:32 -- setup/common.sh@33 -- # return 0 00:03:23.348 17:51:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.348 17:51:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.348 17:51:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.348 17:51:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.348 17:51:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:23.348 node0=512 expecting 512 00:03:23.348 17:51:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.348 17:51:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.348 17:51:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.348 17:51:32 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:23.348 node1=512 expecting 512 00:03:23.348 17:51:32 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:23.348 00:03:23.348 real 0m3.100s 00:03:23.348 user 0m1.201s 00:03:23.348 sys 0m1.977s 00:03:23.348 17:51:32 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:23.348 17:51:32 -- common/autotest_common.sh@10 -- # set +x 00:03:23.348 ************************************ 00:03:23.348 END TEST even_2G_alloc 00:03:23.348 ************************************ 00:03:23.348 17:51:32 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:23.348 17:51:32 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:23.348 17:51:32 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:23.348 17:51:32 -- common/autotest_common.sh@10 -- # set +x 00:03:23.607 ************************************ 00:03:23.607 START TEST odd_alloc 00:03:23.607 ************************************ 00:03:23.607 17:51:32 -- common/autotest_common.sh@1121 -- # odd_alloc 00:03:23.607 17:51:32 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:23.607 17:51:32 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:23.607 17:51:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:23.607 17:51:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:23.607 17:51:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:23.607 17:51:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.607 17:51:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:23.607 17:51:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.607 17:51:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.607 17:51:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.607 17:51:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:23.607 17:51:32 -- setup/hugepages.sh@83 -- # : 513 00:03:23.607 17:51:32 -- setup/hugepages.sh@84 -- # : 1 00:03:23.607 17:51:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:23.607 17:51:32 -- setup/hugepages.sh@83 -- # : 0 00:03:23.607 17:51:32 -- setup/hugepages.sh@84 -- # : 0 00:03:23.607 17:51:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:23.607 17:51:32 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:23.607 17:51:32 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:23.607 17:51:32 -- setup/hugepages.sh@160 -- # setup output 00:03:23.607 17:51:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.607 17:51:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:26.138 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.138 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.138 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.402 17:51:35 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:26.402 17:51:35 -- setup/hugepages.sh@89 -- # local node 00:03:26.402 17:51:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.402 17:51:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.402 17:51:35 -- setup/hugepages.sh@92 -- # local surp 00:03:26.402 17:51:35 -- setup/hugepages.sh@93 -- # local resv 00:03:26.402 17:51:35 -- setup/hugepages.sh@94 -- # local anon 00:03:26.402 17:51:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.402 17:51:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.402 17:51:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.402 17:51:35 -- setup/common.sh@18 -- # local node= 00:03:26.402 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.402 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.402 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.402 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.402 17:51:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.402 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.402 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.402 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46635728 kB' 'MemAvailable: 50214664 kB' 'Buffers: 5092 kB' 'Cached: 9192180 kB' 'SwapCached: 0 kB' 'Active: 6220608 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661900 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447788 kB' 'Mapped: 160432 kB' 'Shmem: 5216792 kB' 'KReclaimable: 190796 kB' 'Slab: 577984 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387188 kB' 'KernelStack: 16400 kB' 'PageTables: 7292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 6864196 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.402 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.402 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.403 17:51:35 -- setup/common.sh@33 -- # echo 0 00:03:26.403 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.403 17:51:35 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.403 17:51:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.403 17:51:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.403 17:51:35 -- setup/common.sh@18 -- # local node= 00:03:26.403 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.403 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.403 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.403 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.403 17:51:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.403 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.403 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46636816 kB' 'MemAvailable: 50215752 kB' 'Buffers: 5092 kB' 'Cached: 9192184 kB' 'SwapCached: 0 kB' 'Active: 6219944 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661236 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447636 kB' 'Mapped: 160356 kB' 'Shmem: 5216796 kB' 'KReclaimable: 190796 kB' 'Slab: 578004 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387208 kB' 'KernelStack: 16448 kB' 'PageTables: 7060 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 6862820 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202964 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.403 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.403 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.404 17:51:35 -- setup/common.sh@33 -- # echo 0 00:03:26.404 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.404 17:51:35 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.404 17:51:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.404 17:51:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.404 17:51:35 -- setup/common.sh@18 -- # local node= 00:03:26.404 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.404 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.404 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.404 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.404 17:51:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.404 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.404 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46636368 kB' 'MemAvailable: 50215304 kB' 'Buffers: 5092 kB' 'Cached: 9192196 kB' 'SwapCached: 0 kB' 'Active: 6219796 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661088 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447440 kB' 'Mapped: 160356 kB' 'Shmem: 5216808 kB' 'KReclaimable: 190796 kB' 'Slab: 578004 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387208 kB' 'KernelStack: 16496 kB' 'PageTables: 7344 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 6862836 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.404 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.404 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.405 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.405 17:51:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.406 17:51:35 -- setup/common.sh@33 -- # echo 0 00:03:26.406 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.406 17:51:35 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.406 17:51:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:26.406 nr_hugepages=1025 00:03:26.406 17:51:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.406 resv_hugepages=0 00:03:26.406 17:51:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.406 surplus_hugepages=0 00:03:26.406 17:51:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.406 anon_hugepages=0 00:03:26.406 17:51:35 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.406 17:51:35 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:26.406 17:51:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.406 17:51:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.406 17:51:35 -- setup/common.sh@18 -- # local node= 00:03:26.406 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.406 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.406 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.406 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.406 17:51:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.406 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.406 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46634352 kB' 'MemAvailable: 50213288 kB' 'Buffers: 5092 kB' 'Cached: 9192196 kB' 'SwapCached: 0 kB' 'Active: 6220024 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661316 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447668 kB' 'Mapped: 160356 kB' 'Shmem: 5216808 kB' 'KReclaimable: 190796 kB' 'Slab: 578004 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387208 kB' 'KernelStack: 16512 kB' 'PageTables: 7540 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37486804 kB' 'Committed_AS: 6864240 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203076 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.406 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.406 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.407 17:51:35 -- setup/common.sh@33 -- # echo 1025 00:03:26.407 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.407 17:51:35 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:26.407 17:51:35 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.407 17:51:35 -- setup/hugepages.sh@27 -- # local node 00:03:26.407 17:51:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.407 17:51:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:26.407 17:51:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.407 17:51:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:26.407 17:51:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.407 17:51:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.407 17:51:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.407 17:51:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.407 17:51:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.407 17:51:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.407 17:51:35 -- setup/common.sh@18 -- # local node=0 00:03:26.407 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.407 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.407 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.407 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.407 17:51:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.407 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.407 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.407 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28124512 kB' 'MemUsed: 4462552 kB' 'SwapCached: 0 kB' 'Active: 2112592 kB' 'Inactive: 77644 kB' 'Active(anon): 1730856 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998668 kB' 'Mapped: 63384 kB' 'AnonPages: 194648 kB' 'Shmem: 1539288 kB' 'KernelStack: 9544 kB' 'PageTables: 3784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360508 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 238140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.407 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.407 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.408 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.408 17:51:35 -- setup/common.sh@33 -- # echo 0 00:03:26.408 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.408 17:51:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.408 17:51:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.408 17:51:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.408 17:51:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:26.408 17:51:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.408 17:51:35 -- setup/common.sh@18 -- # local node=1 00:03:26.408 17:51:35 -- setup/common.sh@19 -- # local var val 00:03:26.408 17:51:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.408 17:51:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.408 17:51:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:26.408 17:51:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:26.408 17:51:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.408 17:51:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.408 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 18510324 kB' 'MemUsed: 9198216 kB' 'SwapCached: 0 kB' 'Active: 4107256 kB' 'Inactive: 3344128 kB' 'Active(anon): 3930284 kB' 'Inactive(anon): 0 kB' 'Active(file): 176972 kB' 'Inactive(file): 3344128 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7198644 kB' 'Mapped: 96972 kB' 'AnonPages: 252796 kB' 'Shmem: 3677544 kB' 'KernelStack: 7064 kB' 'PageTables: 3692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68428 kB' 'Slab: 217488 kB' 'SReclaimable: 68428 kB' 'SUnreclaim: 149060 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # continue 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.409 17:51:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.409 17:51:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.409 17:51:35 -- setup/common.sh@33 -- # echo 0 00:03:26.409 17:51:35 -- setup/common.sh@33 -- # return 0 00:03:26.409 17:51:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.409 17:51:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.409 17:51:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.409 17:51:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.409 17:51:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:26.409 node0=512 expecting 513 00:03:26.409 17:51:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.409 17:51:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.409 17:51:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.409 17:51:35 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:26.409 node1=513 expecting 512 00:03:26.409 17:51:35 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:26.409 00:03:26.409 real 0m2.960s 00:03:26.409 user 0m1.069s 00:03:26.409 sys 0m1.856s 00:03:26.410 17:51:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:26.410 17:51:35 -- common/autotest_common.sh@10 -- # set +x 00:03:26.410 ************************************ 00:03:26.410 END TEST odd_alloc 00:03:26.410 ************************************ 00:03:26.410 17:51:35 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:26.410 17:51:35 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:26.410 17:51:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:26.410 17:51:35 -- common/autotest_common.sh@10 -- # set +x 00:03:26.668 ************************************ 00:03:26.668 START TEST custom_alloc 00:03:26.668 ************************************ 00:03:26.668 17:51:35 -- common/autotest_common.sh@1121 -- # custom_alloc 00:03:26.668 17:51:35 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:26.668 17:51:35 -- setup/hugepages.sh@169 -- # local node 00:03:26.668 17:51:35 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:26.668 17:51:35 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:26.669 17:51:35 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:26.669 17:51:35 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:26.669 17:51:35 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:26.669 17:51:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:26.669 17:51:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.669 17:51:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:26.669 17:51:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.669 17:51:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.669 17:51:35 -- setup/hugepages.sh@83 -- # : 256 00:03:26.669 17:51:35 -- setup/hugepages.sh@84 -- # : 1 00:03:26.669 17:51:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:26.669 17:51:35 -- setup/hugepages.sh@83 -- # : 0 00:03:26.669 17:51:35 -- setup/hugepages.sh@84 -- # : 0 00:03:26.669 17:51:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:26.669 17:51:35 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:26.669 17:51:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:26.669 17:51:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:26.669 17:51:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.669 17:51:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.669 17:51:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.669 17:51:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.669 17:51:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.669 17:51:35 -- setup/hugepages.sh@78 -- # return 0 00:03:26.669 17:51:35 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:26.669 17:51:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.669 17:51:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.669 17:51:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:26.669 17:51:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:26.669 17:51:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:26.669 17:51:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:26.669 17:51:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:26.669 17:51:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:26.669 17:51:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:26.669 17:51:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.669 17:51:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:26.669 17:51:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:26.669 17:51:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:26.669 17:51:35 -- setup/hugepages.sh@78 -- # return 0 00:03:26.669 17:51:35 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:26.669 17:51:35 -- setup/hugepages.sh@187 -- # setup output 00:03:26.669 17:51:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:26.669 17:51:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:29.198 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.198 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:29.198 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:29.463 17:51:38 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:29.463 17:51:38 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:29.463 17:51:38 -- setup/hugepages.sh@89 -- # local node 00:03:29.463 17:51:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.463 17:51:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.463 17:51:38 -- setup/hugepages.sh@92 -- # local surp 00:03:29.463 17:51:38 -- setup/hugepages.sh@93 -- # local resv 00:03:29.463 17:51:38 -- setup/hugepages.sh@94 -- # local anon 00:03:29.463 17:51:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.463 17:51:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.463 17:51:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.463 17:51:38 -- setup/common.sh@18 -- # local node= 00:03:29.463 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.463 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.463 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.463 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.463 17:51:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.463 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.463 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.463 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45582208 kB' 'MemAvailable: 49161144 kB' 'Buffers: 5092 kB' 'Cached: 9192304 kB' 'SwapCached: 0 kB' 'Active: 6219540 kB' 'Inactive: 3421772 kB' 'Active(anon): 5660832 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447152 kB' 'Mapped: 160380 kB' 'Shmem: 5216916 kB' 'KReclaimable: 190796 kB' 'Slab: 577908 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387112 kB' 'KernelStack: 16464 kB' 'PageTables: 7432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 6862464 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:29.463 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.463 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.463 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.463 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.463 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.464 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.464 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.464 17:51:38 -- setup/common.sh@33 -- # echo 0 00:03:29.464 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.464 17:51:38 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.464 17:51:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.464 17:51:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.465 17:51:38 -- setup/common.sh@18 -- # local node= 00:03:29.465 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.465 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.465 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.465 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.465 17:51:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.465 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.465 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45582096 kB' 'MemAvailable: 49161032 kB' 'Buffers: 5092 kB' 'Cached: 9192304 kB' 'SwapCached: 0 kB' 'Active: 6220144 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661436 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447724 kB' 'Mapped: 160380 kB' 'Shmem: 5216916 kB' 'KReclaimable: 190796 kB' 'Slab: 577908 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387112 kB' 'KernelStack: 16448 kB' 'PageTables: 7364 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 6862476 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.465 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.465 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.466 17:51:38 -- setup/common.sh@33 -- # echo 0 00:03:29.466 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.466 17:51:38 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.466 17:51:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.466 17:51:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.466 17:51:38 -- setup/common.sh@18 -- # local node= 00:03:29.466 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.466 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.466 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.466 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.466 17:51:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.466 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.466 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45582904 kB' 'MemAvailable: 49161840 kB' 'Buffers: 5092 kB' 'Cached: 9192320 kB' 'SwapCached: 0 kB' 'Active: 6219832 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661124 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447384 kB' 'Mapped: 160380 kB' 'Shmem: 5216932 kB' 'KReclaimable: 190796 kB' 'Slab: 577904 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387108 kB' 'KernelStack: 16448 kB' 'PageTables: 7380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 6862492 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.466 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.466 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.467 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.467 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.468 17:51:38 -- setup/common.sh@33 -- # echo 0 00:03:29.468 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.468 17:51:38 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.468 17:51:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:29.468 nr_hugepages=1536 00:03:29.468 17:51:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.468 resv_hugepages=0 00:03:29.468 17:51:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.468 surplus_hugepages=0 00:03:29.468 17:51:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.468 anon_hugepages=0 00:03:29.468 17:51:38 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.468 17:51:38 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:29.468 17:51:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.468 17:51:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.468 17:51:38 -- setup/common.sh@18 -- # local node= 00:03:29.468 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.468 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.468 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.468 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.468 17:51:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.468 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.468 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 45582904 kB' 'MemAvailable: 49161840 kB' 'Buffers: 5092 kB' 'Cached: 9192332 kB' 'SwapCached: 0 kB' 'Active: 6220176 kB' 'Inactive: 3421772 kB' 'Active(anon): 5661468 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447732 kB' 'Mapped: 160380 kB' 'Shmem: 5216944 kB' 'KReclaimable: 190796 kB' 'Slab: 577904 kB' 'SReclaimable: 190796 kB' 'SUnreclaim: 387108 kB' 'KernelStack: 16464 kB' 'PageTables: 7432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36963540 kB' 'Committed_AS: 6862508 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.468 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.468 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.469 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.469 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.470 17:51:38 -- setup/common.sh@33 -- # echo 1536 00:03:29.470 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.470 17:51:38 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.470 17:51:38 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.470 17:51:38 -- setup/hugepages.sh@27 -- # local node 00:03:29.470 17:51:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.470 17:51:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.470 17:51:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.470 17:51:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.470 17:51:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.470 17:51:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.470 17:51:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.470 17:51:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.470 17:51:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.470 17:51:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.470 17:51:38 -- setup/common.sh@18 -- # local node=0 00:03:29.470 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.470 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.470 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.470 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.470 17:51:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.470 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.470 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 28113240 kB' 'MemUsed: 4473824 kB' 'SwapCached: 0 kB' 'Active: 2112708 kB' 'Inactive: 77644 kB' 'Active(anon): 1730972 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998752 kB' 'Mapped: 63384 kB' 'AnonPages: 194796 kB' 'Shmem: 1539372 kB' 'KernelStack: 9576 kB' 'PageTables: 3852 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360372 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 238004 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.470 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.470 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@33 -- # echo 0 00:03:29.471 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.471 17:51:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.471 17:51:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.471 17:51:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.471 17:51:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.471 17:51:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.471 17:51:38 -- setup/common.sh@18 -- # local node=1 00:03:29.471 17:51:38 -- setup/common.sh@19 -- # local var val 00:03:29.471 17:51:38 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.471 17:51:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.471 17:51:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.471 17:51:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.471 17:51:38 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.471 17:51:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27708540 kB' 'MemFree: 17469780 kB' 'MemUsed: 10238760 kB' 'SwapCached: 0 kB' 'Active: 4107300 kB' 'Inactive: 3344128 kB' 'Active(anon): 3930328 kB' 'Inactive(anon): 0 kB' 'Active(file): 176972 kB' 'Inactive(file): 3344128 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 7198676 kB' 'Mapped: 96996 kB' 'AnonPages: 252776 kB' 'Shmem: 3677576 kB' 'KernelStack: 6888 kB' 'PageTables: 3580 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 68428 kB' 'Slab: 217532 kB' 'SReclaimable: 68428 kB' 'SUnreclaim: 149104 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.471 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.471 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # continue 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.472 17:51:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.472 17:51:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.472 17:51:38 -- setup/common.sh@33 -- # echo 0 00:03:29.472 17:51:38 -- setup/common.sh@33 -- # return 0 00:03:29.472 17:51:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.472 17:51:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.472 17:51:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.472 17:51:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.472 17:51:38 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.472 node0=512 expecting 512 00:03:29.472 17:51:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.472 17:51:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.472 17:51:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.472 17:51:38 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:29.472 node1=1024 expecting 1024 00:03:29.472 17:51:38 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:29.472 00:03:29.472 real 0m2.899s 00:03:29.472 user 0m1.058s 00:03:29.472 sys 0m1.866s 00:03:29.472 17:51:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:29.472 17:51:38 -- common/autotest_common.sh@10 -- # set +x 00:03:29.472 ************************************ 00:03:29.472 END TEST custom_alloc 00:03:29.472 ************************************ 00:03:29.472 17:51:38 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:29.472 17:51:38 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:29.472 17:51:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:29.472 17:51:38 -- common/autotest_common.sh@10 -- # set +x 00:03:29.731 ************************************ 00:03:29.731 START TEST no_shrink_alloc 00:03:29.731 ************************************ 00:03:29.731 17:51:38 -- common/autotest_common.sh@1121 -- # no_shrink_alloc 00:03:29.731 17:51:38 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:29.731 17:51:38 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:29.731 17:51:38 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:29.731 17:51:38 -- setup/hugepages.sh@51 -- # shift 00:03:29.731 17:51:38 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:29.731 17:51:38 -- setup/hugepages.sh@52 -- # local node_ids 00:03:29.731 17:51:38 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:29.731 17:51:38 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:29.731 17:51:38 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:29.731 17:51:38 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:29.731 17:51:38 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:29.731 17:51:38 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:29.731 17:51:38 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:29.731 17:51:38 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:29.731 17:51:38 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:29.731 17:51:38 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:29.731 17:51:38 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:29.731 17:51:38 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:29.731 17:51:38 -- setup/hugepages.sh@73 -- # return 0 00:03:29.731 17:51:38 -- setup/hugepages.sh@198 -- # setup output 00:03:29.731 17:51:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:29.731 17:51:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:33.050 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:33.050 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:33.050 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:33.050 17:51:41 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:33.050 17:51:41 -- setup/hugepages.sh@89 -- # local node 00:03:33.050 17:51:41 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:33.050 17:51:41 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:33.050 17:51:41 -- setup/hugepages.sh@92 -- # local surp 00:03:33.050 17:51:41 -- setup/hugepages.sh@93 -- # local resv 00:03:33.050 17:51:41 -- setup/hugepages.sh@94 -- # local anon 00:03:33.050 17:51:41 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:33.050 17:51:41 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:33.050 17:51:41 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:33.050 17:51:41 -- setup/common.sh@18 -- # local node= 00:03:33.050 17:51:41 -- setup/common.sh@19 -- # local var val 00:03:33.050 17:51:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.050 17:51:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.050 17:51:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.050 17:51:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.050 17:51:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.050 17:51:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.050 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.050 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.050 17:51:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46615652 kB' 'MemAvailable: 50194584 kB' 'Buffers: 5092 kB' 'Cached: 9192416 kB' 'SwapCached: 0 kB' 'Active: 6222260 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663552 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449836 kB' 'Mapped: 160420 kB' 'Shmem: 5217028 kB' 'KReclaimable: 190788 kB' 'Slab: 578328 kB' 'SReclaimable: 190788 kB' 'SUnreclaim: 387540 kB' 'KernelStack: 16448 kB' 'PageTables: 7384 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6862964 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.051 17:51:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:33.051 17:51:41 -- setup/common.sh@33 -- # echo 0 00:03:33.051 17:51:41 -- setup/common.sh@33 -- # return 0 00:03:33.051 17:51:41 -- setup/hugepages.sh@97 -- # anon=0 00:03:33.051 17:51:41 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:33.051 17:51:41 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:33.051 17:51:41 -- setup/common.sh@18 -- # local node= 00:03:33.051 17:51:41 -- setup/common.sh@19 -- # local var val 00:03:33.051 17:51:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.051 17:51:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.051 17:51:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.051 17:51:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.051 17:51:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.051 17:51:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.051 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46616784 kB' 'MemAvailable: 50195716 kB' 'Buffers: 5092 kB' 'Cached: 9192420 kB' 'SwapCached: 0 kB' 'Active: 6222236 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663528 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449812 kB' 'Mapped: 160408 kB' 'Shmem: 5217032 kB' 'KReclaimable: 190788 kB' 'Slab: 578328 kB' 'SReclaimable: 190788 kB' 'SUnreclaim: 387540 kB' 'KernelStack: 16448 kB' 'PageTables: 7376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6865380 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202996 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.052 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.052 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.053 17:51:41 -- setup/common.sh@33 -- # echo 0 00:03:33.053 17:51:41 -- setup/common.sh@33 -- # return 0 00:03:33.053 17:51:41 -- setup/hugepages.sh@99 -- # surp=0 00:03:33.053 17:51:41 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:33.053 17:51:41 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:33.053 17:51:41 -- setup/common.sh@18 -- # local node= 00:03:33.053 17:51:41 -- setup/common.sh@19 -- # local var val 00:03:33.053 17:51:41 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.053 17:51:41 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.053 17:51:41 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.053 17:51:41 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.053 17:51:41 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.053 17:51:41 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46617940 kB' 'MemAvailable: 50196872 kB' 'Buffers: 5092 kB' 'Cached: 9192428 kB' 'SwapCached: 0 kB' 'Active: 6222620 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663912 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450252 kB' 'Mapped: 160416 kB' 'Shmem: 5217040 kB' 'KReclaimable: 190788 kB' 'Slab: 578328 kB' 'SReclaimable: 190788 kB' 'SUnreclaim: 387540 kB' 'KernelStack: 16416 kB' 'PageTables: 7296 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6864008 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 202964 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.053 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.053 17:51:41 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:41 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:41 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:33.054 17:51:42 -- setup/common.sh@33 -- # echo 0 00:03:33.054 17:51:42 -- setup/common.sh@33 -- # return 0 00:03:33.054 17:51:42 -- setup/hugepages.sh@100 -- # resv=0 00:03:33.054 17:51:42 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:33.054 nr_hugepages=1024 00:03:33.054 17:51:42 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:33.054 resv_hugepages=0 00:03:33.054 17:51:42 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:33.054 surplus_hugepages=0 00:03:33.054 17:51:42 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:33.054 anon_hugepages=0 00:03:33.054 17:51:42 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:33.054 17:51:42 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:33.054 17:51:42 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:33.054 17:51:42 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:33.054 17:51:42 -- setup/common.sh@18 -- # local node= 00:03:33.054 17:51:42 -- setup/common.sh@19 -- # local var val 00:03:33.054 17:51:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.054 17:51:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.054 17:51:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:33.054 17:51:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:33.054 17:51:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.054 17:51:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46618936 kB' 'MemAvailable: 50197868 kB' 'Buffers: 5092 kB' 'Cached: 9192448 kB' 'SwapCached: 0 kB' 'Active: 6222084 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663376 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449608 kB' 'Mapped: 160416 kB' 'Shmem: 5217060 kB' 'KReclaimable: 190788 kB' 'Slab: 578328 kB' 'SReclaimable: 190788 kB' 'SUnreclaim: 387540 kB' 'KernelStack: 16496 kB' 'PageTables: 7176 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6864024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203012 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.054 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.054 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.055 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.055 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:33.056 17:51:42 -- setup/common.sh@33 -- # echo 1024 00:03:33.056 17:51:42 -- setup/common.sh@33 -- # return 0 00:03:33.056 17:51:42 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:33.056 17:51:42 -- setup/hugepages.sh@112 -- # get_nodes 00:03:33.056 17:51:42 -- setup/hugepages.sh@27 -- # local node 00:03:33.056 17:51:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:33.056 17:51:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:33.056 17:51:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:33.056 17:51:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:33.056 17:51:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:33.056 17:51:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:33.056 17:51:42 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:33.056 17:51:42 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:33.056 17:51:42 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:33.056 17:51:42 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:33.056 17:51:42 -- setup/common.sh@18 -- # local node=0 00:03:33.056 17:51:42 -- setup/common.sh@19 -- # local var val 00:03:33.056 17:51:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:33.056 17:51:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:33.056 17:51:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:33.056 17:51:42 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:33.056 17:51:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:33.056 17:51:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27065772 kB' 'MemUsed: 5521292 kB' 'SwapCached: 0 kB' 'Active: 2115280 kB' 'Inactive: 77644 kB' 'Active(anon): 1733544 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998844 kB' 'Mapped: 63384 kB' 'AnonPages: 197356 kB' 'Shmem: 1539464 kB' 'KernelStack: 9816 kB' 'PageTables: 4128 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360760 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 238392 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.056 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.056 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # continue 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:33.057 17:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:33.057 17:51:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:33.057 17:51:42 -- setup/common.sh@33 -- # echo 0 00:03:33.057 17:51:42 -- setup/common.sh@33 -- # return 0 00:03:33.057 17:51:42 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:33.057 17:51:42 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:33.057 17:51:42 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:33.057 17:51:42 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:33.057 17:51:42 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:33.057 node0=1024 expecting 1024 00:03:33.057 17:51:42 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:33.057 17:51:42 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:33.057 17:51:42 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:33.057 17:51:42 -- setup/hugepages.sh@202 -- # setup output 00:03:33.057 17:51:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:33.057 17:51:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:03:36.352 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:36.352 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:36.352 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:36.352 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:36.352 17:51:45 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:36.352 17:51:45 -- setup/hugepages.sh@89 -- # local node 00:03:36.352 17:51:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:36.352 17:51:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:36.353 17:51:45 -- setup/hugepages.sh@92 -- # local surp 00:03:36.353 17:51:45 -- setup/hugepages.sh@93 -- # local resv 00:03:36.353 17:51:45 -- setup/hugepages.sh@94 -- # local anon 00:03:36.353 17:51:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:36.353 17:51:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:36.353 17:51:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:36.353 17:51:45 -- setup/common.sh@18 -- # local node= 00:03:36.353 17:51:45 -- setup/common.sh@19 -- # local var val 00:03:36.353 17:51:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.353 17:51:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.353 17:51:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.353 17:51:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.353 17:51:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.353 17:51:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46588264 kB' 'MemAvailable: 50167180 kB' 'Buffers: 5092 kB' 'Cached: 9192508 kB' 'SwapCached: 0 kB' 'Active: 6223972 kB' 'Inactive: 3421772 kB' 'Active(anon): 5665264 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450876 kB' 'Mapped: 160508 kB' 'Shmem: 5217120 kB' 'KReclaimable: 190756 kB' 'Slab: 577460 kB' 'SReclaimable: 190756 kB' 'SUnreclaim: 386704 kB' 'KernelStack: 16624 kB' 'PageTables: 7432 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6864024 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203172 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.353 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.353 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:36.354 17:51:45 -- setup/common.sh@33 -- # echo 0 00:03:36.354 17:51:45 -- setup/common.sh@33 -- # return 0 00:03:36.354 17:51:45 -- setup/hugepages.sh@97 -- # anon=0 00:03:36.354 17:51:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:36.354 17:51:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:36.354 17:51:45 -- setup/common.sh@18 -- # local node= 00:03:36.354 17:51:45 -- setup/common.sh@19 -- # local var val 00:03:36.354 17:51:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.354 17:51:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.354 17:51:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.354 17:51:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.354 17:51:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.354 17:51:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46588428 kB' 'MemAvailable: 50167344 kB' 'Buffers: 5092 kB' 'Cached: 9192512 kB' 'SwapCached: 0 kB' 'Active: 6222820 kB' 'Inactive: 3421772 kB' 'Active(anon): 5664112 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450256 kB' 'Mapped: 160424 kB' 'Shmem: 5217124 kB' 'KReclaimable: 190756 kB' 'Slab: 577484 kB' 'SReclaimable: 190756 kB' 'SUnreclaim: 386728 kB' 'KernelStack: 16464 kB' 'PageTables: 6996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6863012 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203044 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.354 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.354 17:51:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.355 17:51:45 -- setup/common.sh@33 -- # echo 0 00:03:36.355 17:51:45 -- setup/common.sh@33 -- # return 0 00:03:36.355 17:51:45 -- setup/hugepages.sh@99 -- # surp=0 00:03:36.355 17:51:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:36.355 17:51:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:36.355 17:51:45 -- setup/common.sh@18 -- # local node= 00:03:36.355 17:51:45 -- setup/common.sh@19 -- # local var val 00:03:36.355 17:51:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.355 17:51:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.355 17:51:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.355 17:51:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.355 17:51:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.355 17:51:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46588180 kB' 'MemAvailable: 50167096 kB' 'Buffers: 5092 kB' 'Cached: 9192520 kB' 'SwapCached: 0 kB' 'Active: 6222308 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663600 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449708 kB' 'Mapped: 160416 kB' 'Shmem: 5217132 kB' 'KReclaimable: 190756 kB' 'Slab: 577516 kB' 'SReclaimable: 190756 kB' 'SUnreclaim: 386760 kB' 'KernelStack: 16432 kB' 'PageTables: 7336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6863028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.355 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.355 17:51:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.356 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.356 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:36.357 17:51:45 -- setup/common.sh@33 -- # echo 0 00:03:36.357 17:51:45 -- setup/common.sh@33 -- # return 0 00:03:36.357 17:51:45 -- setup/hugepages.sh@100 -- # resv=0 00:03:36.357 17:51:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:36.357 nr_hugepages=1024 00:03:36.357 17:51:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:36.357 resv_hugepages=0 00:03:36.357 17:51:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:36.357 surplus_hugepages=0 00:03:36.357 17:51:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:36.357 anon_hugepages=0 00:03:36.357 17:51:45 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:36.357 17:51:45 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:36.357 17:51:45 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:36.357 17:51:45 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:36.357 17:51:45 -- setup/common.sh@18 -- # local node= 00:03:36.357 17:51:45 -- setup/common.sh@19 -- # local var val 00:03:36.357 17:51:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.357 17:51:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.357 17:51:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:36.357 17:51:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:36.357 17:51:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.357 17:51:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.357 17:51:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60295604 kB' 'MemFree: 46587424 kB' 'MemAvailable: 50166340 kB' 'Buffers: 5092 kB' 'Cached: 9192544 kB' 'SwapCached: 0 kB' 'Active: 6222460 kB' 'Inactive: 3421772 kB' 'Active(anon): 5663752 kB' 'Inactive(anon): 0 kB' 'Active(file): 558708 kB' 'Inactive(file): 3421772 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449832 kB' 'Mapped: 160416 kB' 'Shmem: 5217156 kB' 'KReclaimable: 190756 kB' 'Slab: 577516 kB' 'SReclaimable: 190756 kB' 'SUnreclaim: 386760 kB' 'KernelStack: 16448 kB' 'PageTables: 7388 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37487828 kB' 'Committed_AS: 6863044 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 203060 kB' 'VmallocChunk: 0 kB' 'Percpu: 50560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1590744 kB' 'DirectMap2M: 14862336 kB' 'DirectMap1G: 52428800 kB' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.357 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.357 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:36.358 17:51:45 -- setup/common.sh@33 -- # echo 1024 00:03:36.358 17:51:45 -- setup/common.sh@33 -- # return 0 00:03:36.358 17:51:45 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:36.358 17:51:45 -- setup/hugepages.sh@112 -- # get_nodes 00:03:36.358 17:51:45 -- setup/hugepages.sh@27 -- # local node 00:03:36.358 17:51:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:36.358 17:51:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:36.358 17:51:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:36.358 17:51:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:36.358 17:51:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:36.358 17:51:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:36.358 17:51:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:36.358 17:51:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:36.358 17:51:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:36.358 17:51:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:36.358 17:51:45 -- setup/common.sh@18 -- # local node=0 00:03:36.358 17:51:45 -- setup/common.sh@19 -- # local var val 00:03:36.358 17:51:45 -- setup/common.sh@20 -- # local mem_f mem 00:03:36.358 17:51:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:36.358 17:51:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:36.358 17:51:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:36.358 17:51:45 -- setup/common.sh@28 -- # mapfile -t mem 00:03:36.358 17:51:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32587064 kB' 'MemFree: 27057188 kB' 'MemUsed: 5529876 kB' 'SwapCached: 0 kB' 'Active: 2114116 kB' 'Inactive: 77644 kB' 'Active(anon): 1732380 kB' 'Inactive(anon): 0 kB' 'Active(file): 381736 kB' 'Inactive(file): 77644 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1998844 kB' 'Mapped: 63384 kB' 'AnonPages: 196044 kB' 'Shmem: 1539464 kB' 'KernelStack: 9544 kB' 'PageTables: 3756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 122368 kB' 'Slab: 360176 kB' 'SReclaimable: 122368 kB' 'SUnreclaim: 237808 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.358 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.358 17:51:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # continue 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # IFS=': ' 00:03:36.359 17:51:45 -- setup/common.sh@31 -- # read -r var val _ 00:03:36.359 17:51:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:36.359 17:51:45 -- setup/common.sh@33 -- # echo 0 00:03:36.359 17:51:45 -- setup/common.sh@33 -- # return 0 00:03:36.359 17:51:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:36.359 17:51:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:36.359 17:51:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:36.359 17:51:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:36.359 17:51:45 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:36.359 node0=1024 expecting 1024 00:03:36.359 17:51:45 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:36.359 00:03:36.359 real 0m6.386s 00:03:36.359 user 0m2.431s 00:03:36.359 sys 0m4.064s 00:03:36.359 17:51:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:36.359 17:51:45 -- common/autotest_common.sh@10 -- # set +x 00:03:36.359 ************************************ 00:03:36.359 END TEST no_shrink_alloc 00:03:36.359 ************************************ 00:03:36.359 17:51:45 -- setup/hugepages.sh@217 -- # clear_hp 00:03:36.359 17:51:45 -- setup/hugepages.sh@37 -- # local node hp 00:03:36.359 17:51:45 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:36.359 17:51:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.359 17:51:45 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.359 17:51:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.359 17:51:45 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.359 17:51:45 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:36.359 17:51:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.359 17:51:45 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.359 17:51:45 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:36.359 17:51:45 -- setup/hugepages.sh@41 -- # echo 0 00:03:36.359 17:51:45 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:36.359 17:51:45 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:36.359 00:03:36.359 real 0m26.099s 00:03:36.359 user 0m8.580s 00:03:36.359 sys 0m14.502s 00:03:36.359 17:51:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:36.359 17:51:45 -- common/autotest_common.sh@10 -- # set +x 00:03:36.359 ************************************ 00:03:36.359 END TEST hugepages 00:03:36.359 ************************************ 00:03:36.359 17:51:45 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:36.359 17:51:45 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:36.359 17:51:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:36.359 17:51:45 -- common/autotest_common.sh@10 -- # set +x 00:03:36.359 ************************************ 00:03:36.359 START TEST driver 00:03:36.359 ************************************ 00:03:36.359 17:51:45 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/driver.sh 00:03:36.359 * Looking for test storage... 00:03:36.360 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:36.360 17:51:45 -- setup/driver.sh@68 -- # setup reset 00:03:36.360 17:51:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:36.360 17:51:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:40.553 17:51:49 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:40.553 17:51:49 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:40.553 17:51:49 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:40.553 17:51:49 -- common/autotest_common.sh@10 -- # set +x 00:03:40.811 ************************************ 00:03:40.811 START TEST guess_driver 00:03:40.811 ************************************ 00:03:40.811 17:51:49 -- common/autotest_common.sh@1121 -- # guess_driver 00:03:40.811 17:51:49 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:40.811 17:51:49 -- setup/driver.sh@47 -- # local fail=0 00:03:40.811 17:51:49 -- setup/driver.sh@49 -- # pick_driver 00:03:40.811 17:51:49 -- setup/driver.sh@36 -- # vfio 00:03:40.811 17:51:49 -- setup/driver.sh@21 -- # local iommu_grups 00:03:40.811 17:51:49 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:40.811 17:51:49 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:40.811 17:51:49 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:40.811 17:51:49 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:40.811 17:51:49 -- setup/driver.sh@29 -- # (( 163 > 0 )) 00:03:40.811 17:51:49 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:40.811 17:51:49 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:40.811 17:51:49 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:40.811 17:51:49 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:40.811 17:51:49 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:40.811 insmod /lib/modules/6.7.0-68.fc38.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:40.811 17:51:49 -- setup/driver.sh@30 -- # return 0 00:03:40.811 17:51:49 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:40.811 17:51:49 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:40.811 17:51:49 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:40.811 17:51:49 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:40.811 Looking for driver=vfio-pci 00:03:40.811 17:51:49 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:40.811 17:51:49 -- setup/driver.sh@45 -- # setup output config 00:03:40.811 17:51:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:40.811 17:51:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:44.097 17:51:52 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:44.097 17:51:52 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:44.097 17:51:52 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:47.387 17:51:55 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:47.387 17:51:55 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:47.387 17:51:55 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:47.387 17:51:56 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:47.387 17:51:56 -- setup/driver.sh@65 -- # setup reset 00:03:47.387 17:51:56 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:47.387 17:51:56 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:51.618 00:03:51.618 real 0m10.571s 00:03:51.618 user 0m2.292s 00:03:51.618 sys 0m4.473s 00:03:51.618 17:52:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:51.618 17:52:00 -- common/autotest_common.sh@10 -- # set +x 00:03:51.618 ************************************ 00:03:51.618 END TEST guess_driver 00:03:51.618 ************************************ 00:03:51.618 00:03:51.618 real 0m14.928s 00:03:51.618 user 0m3.386s 00:03:51.618 sys 0m6.900s 00:03:51.618 17:52:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:03:51.618 17:52:00 -- common/autotest_common.sh@10 -- # set +x 00:03:51.618 ************************************ 00:03:51.618 END TEST driver 00:03:51.618 ************************************ 00:03:51.618 17:52:00 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:51.618 17:52:00 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:51.618 17:52:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:51.618 17:52:00 -- common/autotest_common.sh@10 -- # set +x 00:03:51.618 ************************************ 00:03:51.618 START TEST devices 00:03:51.618 ************************************ 00:03:51.618 17:52:00 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/devices.sh 00:03:51.618 * Looking for test storage... 00:03:51.618 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup 00:03:51.618 17:52:00 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:51.618 17:52:00 -- setup/devices.sh@192 -- # setup reset 00:03:51.618 17:52:00 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:51.618 17:52:00 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:03:54.908 17:52:03 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:54.908 17:52:03 -- common/autotest_common.sh@1665 -- # zoned_devs=() 00:03:54.908 17:52:03 -- common/autotest_common.sh@1665 -- # local -gA zoned_devs 00:03:54.908 17:52:03 -- common/autotest_common.sh@1666 -- # local nvme bdf 00:03:54.908 17:52:03 -- common/autotest_common.sh@1668 -- # for nvme in /sys/block/nvme* 00:03:54.908 17:52:03 -- common/autotest_common.sh@1669 -- # is_block_zoned nvme0n1 00:03:54.908 17:52:03 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:03:54.908 17:52:03 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:54.908 17:52:03 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:03:54.908 17:52:03 -- setup/devices.sh@196 -- # blocks=() 00:03:54.908 17:52:03 -- setup/devices.sh@196 -- # declare -a blocks 00:03:54.908 17:52:03 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:54.908 17:52:03 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:54.908 17:52:03 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:54.908 17:52:03 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:54.908 17:52:03 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:54.908 17:52:03 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:54.908 17:52:03 -- setup/devices.sh@202 -- # pci=0000:5f:00.0 00:03:54.908 17:52:03 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\f\:\0\0\.\0* ]] 00:03:54.908 17:52:03 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:54.908 17:52:03 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:03:54.908 17:52:03 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:54.908 No valid GPT data, bailing 00:03:54.908 17:52:03 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:54.908 17:52:03 -- scripts/common.sh@391 -- # pt= 00:03:54.908 17:52:03 -- scripts/common.sh@392 -- # return 1 00:03:54.908 17:52:03 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:54.908 17:52:03 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:54.908 17:52:03 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:54.908 17:52:03 -- setup/common.sh@80 -- # echo 4000787030016 00:03:54.908 17:52:03 -- setup/devices.sh@204 -- # (( 4000787030016 >= min_disk_size )) 00:03:54.908 17:52:03 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:54.908 17:52:03 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5f:00.0 00:03:54.908 17:52:03 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:54.908 17:52:03 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:54.908 17:52:03 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:54.908 17:52:03 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:03:54.908 17:52:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:03:54.908 17:52:03 -- common/autotest_common.sh@10 -- # set +x 00:03:54.908 ************************************ 00:03:54.908 START TEST nvme_mount 00:03:54.908 ************************************ 00:03:54.908 17:52:04 -- common/autotest_common.sh@1121 -- # nvme_mount 00:03:54.908 17:52:04 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:54.908 17:52:04 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:54.908 17:52:04 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:54.908 17:52:04 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:54.908 17:52:04 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:54.908 17:52:04 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:54.908 17:52:04 -- setup/common.sh@40 -- # local part_no=1 00:03:54.908 17:52:04 -- setup/common.sh@41 -- # local size=1073741824 00:03:54.908 17:52:04 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:54.909 17:52:04 -- setup/common.sh@44 -- # parts=() 00:03:54.909 17:52:04 -- setup/common.sh@44 -- # local parts 00:03:54.909 17:52:04 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:54.909 17:52:04 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:54.909 17:52:04 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:54.909 17:52:04 -- setup/common.sh@46 -- # (( part++ )) 00:03:54.909 17:52:04 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:54.909 17:52:04 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:54.909 17:52:04 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:54.909 17:52:04 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:56.288 Creating new GPT entries in memory. 00:03:56.288 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:56.288 other utilities. 00:03:56.288 17:52:05 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:56.288 17:52:05 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:56.288 17:52:05 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:56.288 17:52:05 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:56.288 17:52:05 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:57.226 Creating new GPT entries in memory. 00:03:57.226 The operation has completed successfully. 00:03:57.226 17:52:06 -- setup/common.sh@57 -- # (( part++ )) 00:03:57.226 17:52:06 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:57.226 17:52:06 -- setup/common.sh@62 -- # wait 809383 00:03:57.226 17:52:06 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.226 17:52:06 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:57.226 17:52:06 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.226 17:52:06 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:57.226 17:52:06 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:57.226 17:52:06 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.226 17:52:06 -- setup/devices.sh@105 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:57.226 17:52:06 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:03:57.226 17:52:06 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:57.226 17:52:06 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:03:57.226 17:52:06 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:57.226 17:52:06 -- setup/devices.sh@53 -- # local found=0 00:03:57.226 17:52:06 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:57.226 17:52:06 -- setup/devices.sh@56 -- # : 00:03:57.226 17:52:06 -- setup/devices.sh@59 -- # local pci status 00:03:57.226 17:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:57.226 17:52:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:03:57.226 17:52:06 -- setup/devices.sh@47 -- # setup output config 00:03:57.226 17:52:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:57.226 17:52:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:59.764 17:52:08 -- setup/devices.sh@63 -- # found=1 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:59.764 17:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:03:59.764 17:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.024 17:52:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:00.024 17:52:09 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:00.024 17:52:09 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.024 17:52:09 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:00.024 17:52:09 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:00.024 17:52:09 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:00.024 17:52:09 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.024 17:52:09 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.024 17:52:09 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:00.024 17:52:09 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:00.024 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:00.024 17:52:09 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:00.024 17:52:09 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:00.282 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:00.282 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:00.283 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:00.283 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:00.283 17:52:09 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:00.283 17:52:09 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:00.283 17:52:09 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.283 17:52:09 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:00.283 17:52:09 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:00.283 17:52:09 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.542 17:52:09 -- setup/devices.sh@116 -- # verify 0000:5f:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:00.542 17:52:09 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:00.542 17:52:09 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:00.542 17:52:09 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:00.542 17:52:09 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:00.542 17:52:09 -- setup/devices.sh@53 -- # local found=0 00:04:00.542 17:52:09 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:00.542 17:52:09 -- setup/devices.sh@56 -- # : 00:04:00.542 17:52:09 -- setup/devices.sh@59 -- # local pci status 00:04:00.542 17:52:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.542 17:52:09 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:00.542 17:52:09 -- setup/devices.sh@47 -- # setup output config 00:04:00.542 17:52:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:00.542 17:52:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:03.095 17:52:11 -- setup/devices.sh@63 -- # found=1 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:11 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:03.095 17:52:11 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:03.095 17:52:12 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:03.095 17:52:12 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:03.095 17:52:12 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:03.095 17:52:12 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:03.095 17:52:12 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:03.095 17:52:12 -- setup/devices.sh@125 -- # verify 0000:5f:00.0 data@nvme0n1 '' '' 00:04:03.095 17:52:12 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:03.095 17:52:12 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:03.095 17:52:12 -- setup/devices.sh@50 -- # local mount_point= 00:04:03.095 17:52:12 -- setup/devices.sh@51 -- # local test_file= 00:04:03.095 17:52:12 -- setup/devices.sh@53 -- # local found=0 00:04:03.095 17:52:12 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:03.095 17:52:12 -- setup/devices.sh@59 -- # local pci status 00:04:03.095 17:52:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:03.095 17:52:12 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:03.095 17:52:12 -- setup/devices.sh@47 -- # setup output config 00:04:03.095 17:52:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:03.095 17:52:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:05.631 17:52:14 -- setup/devices.sh@63 -- # found=1 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.631 17:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:05.631 17:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:05.889 17:52:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:05.889 17:52:14 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:05.889 17:52:14 -- setup/devices.sh@68 -- # return 0 00:04:05.889 17:52:14 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:05.889 17:52:14 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:05.889 17:52:14 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:05.889 17:52:14 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:05.889 17:52:14 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:05.889 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:05.889 00:04:05.889 real 0m10.915s 00:04:05.889 user 0m2.823s 00:04:05.889 sys 0m5.770s 00:04:05.889 17:52:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:05.890 17:52:14 -- common/autotest_common.sh@10 -- # set +x 00:04:05.890 ************************************ 00:04:05.890 END TEST nvme_mount 00:04:05.890 ************************************ 00:04:05.890 17:52:15 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:05.890 17:52:15 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:05.890 17:52:15 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:05.890 17:52:15 -- common/autotest_common.sh@10 -- # set +x 00:04:06.148 ************************************ 00:04:06.148 START TEST dm_mount 00:04:06.148 ************************************ 00:04:06.148 17:52:15 -- common/autotest_common.sh@1121 -- # dm_mount 00:04:06.148 17:52:15 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:06.148 17:52:15 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:06.148 17:52:15 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:06.148 17:52:15 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:06.148 17:52:15 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:06.148 17:52:15 -- setup/common.sh@40 -- # local part_no=2 00:04:06.148 17:52:15 -- setup/common.sh@41 -- # local size=1073741824 00:04:06.148 17:52:15 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:06.148 17:52:15 -- setup/common.sh@44 -- # parts=() 00:04:06.148 17:52:15 -- setup/common.sh@44 -- # local parts 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:06.148 17:52:15 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part++ )) 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:06.148 17:52:15 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part++ )) 00:04:06.148 17:52:15 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:06.148 17:52:15 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:06.148 17:52:15 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:06.149 17:52:15 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:07.084 Creating new GPT entries in memory. 00:04:07.084 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:07.084 other utilities. 00:04:07.084 17:52:16 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:07.084 17:52:16 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:07.084 17:52:16 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:07.084 17:52:16 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:07.084 17:52:16 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:08.462 Creating new GPT entries in memory. 00:04:08.462 The operation has completed successfully. 00:04:08.462 17:52:17 -- setup/common.sh@57 -- # (( part++ )) 00:04:08.462 17:52:17 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:08.462 17:52:17 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:08.462 17:52:17 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:08.462 17:52:17 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:09.398 The operation has completed successfully. 00:04:09.398 17:52:18 -- setup/common.sh@57 -- # (( part++ )) 00:04:09.398 17:52:18 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:09.398 17:52:18 -- setup/common.sh@62 -- # wait 813119 00:04:09.398 17:52:18 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:09.398 17:52:18 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:09.398 17:52:18 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:09.398 17:52:18 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:09.398 17:52:18 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:09.398 17:52:18 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:09.398 17:52:18 -- setup/devices.sh@161 -- # break 00:04:09.398 17:52:18 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:09.398 17:52:18 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:09.398 17:52:18 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:09.398 17:52:18 -- setup/devices.sh@166 -- # dm=dm-0 00:04:09.398 17:52:18 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:09.398 17:52:18 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:09.398 17:52:18 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:09.398 17:52:18 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount size= 00:04:09.398 17:52:18 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:09.399 17:52:18 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:09.399 17:52:18 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:09.399 17:52:18 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:09.399 17:52:18 -- setup/devices.sh@174 -- # verify 0000:5f:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:09.399 17:52:18 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:09.399 17:52:18 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:09.399 17:52:18 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:09.399 17:52:18 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:09.399 17:52:18 -- setup/devices.sh@53 -- # local found=0 00:04:09.399 17:52:18 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:09.399 17:52:18 -- setup/devices.sh@56 -- # : 00:04:09.399 17:52:18 -- setup/devices.sh@59 -- # local pci status 00:04:09.399 17:52:18 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:09.399 17:52:18 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:09.399 17:52:18 -- setup/devices.sh@47 -- # setup output config 00:04:09.399 17:52:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:09.399 17:52:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:11.932 17:52:21 -- setup/devices.sh@63 -- # found=1 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:11.932 17:52:21 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:11.932 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:12.191 17:52:21 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:12.191 17:52:21 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:12.191 17:52:21 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:12.191 17:52:21 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:12.191 17:52:21 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:12.191 17:52:21 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:12.191 17:52:21 -- setup/devices.sh@184 -- # verify 0000:5f:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:12.191 17:52:21 -- setup/devices.sh@48 -- # local dev=0000:5f:00.0 00:04:12.191 17:52:21 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:12.191 17:52:21 -- setup/devices.sh@50 -- # local mount_point= 00:04:12.191 17:52:21 -- setup/devices.sh@51 -- # local test_file= 00:04:12.191 17:52:21 -- setup/devices.sh@53 -- # local found=0 00:04:12.191 17:52:21 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:12.191 17:52:21 -- setup/devices.sh@59 -- # local pci status 00:04:12.191 17:52:21 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:12.191 17:52:21 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5f:00.0 00:04:12.191 17:52:21 -- setup/devices.sh@47 -- # setup output config 00:04:12.191 17:52:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:12.191 17:52:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh config 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:5f:00.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:14.727 17:52:23 -- setup/devices.sh@63 -- # found=1 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.727 17:52:23 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\f\:\0\0\.\0 ]] 00:04:14.727 17:52:23 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:14.986 17:52:23 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:14.986 17:52:23 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:14.986 17:52:23 -- setup/devices.sh@68 -- # return 0 00:04:14.986 17:52:23 -- setup/devices.sh@187 -- # cleanup_dm 00:04:14.986 17:52:23 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:14.986 17:52:23 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:14.986 17:52:23 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:14.986 17:52:24 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:14.986 17:52:24 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:14.986 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:14.986 17:52:24 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:14.986 17:52:24 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:14.986 00:04:14.986 real 0m8.834s 00:04:14.986 user 0m2.018s 00:04:14.986 sys 0m3.779s 00:04:14.986 17:52:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:14.986 17:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:14.986 ************************************ 00:04:14.986 END TEST dm_mount 00:04:14.986 ************************************ 00:04:14.986 17:52:24 -- setup/devices.sh@1 -- # cleanup 00:04:14.986 17:52:24 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:14.986 17:52:24 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/nvme_mount 00:04:14.986 17:52:24 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:14.986 17:52:24 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:14.986 17:52:24 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:14.986 17:52:24 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:15.244 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:15.244 /dev/nvme0n1: 8 bytes were erased at offset 0x3a3817d5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:15.244 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:15.244 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:15.244 17:52:24 -- setup/devices.sh@12 -- # cleanup_dm 00:04:15.244 17:52:24 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/setup/dm_mount 00:04:15.244 17:52:24 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:15.245 17:52:24 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:15.245 17:52:24 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:15.245 17:52:24 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:15.245 17:52:24 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:15.245 00:04:15.245 real 0m23.804s 00:04:15.245 user 0m6.154s 00:04:15.245 sys 0m12.048s 00:04:15.245 17:52:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:15.245 17:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:15.245 ************************************ 00:04:15.245 END TEST devices 00:04:15.245 ************************************ 00:04:15.245 00:04:15.245 real 1m30.214s 00:04:15.245 user 0m25.568s 00:04:15.245 sys 0m47.658s 00:04:15.245 17:52:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:15.245 17:52:24 -- common/autotest_common.sh@10 -- # set +x 00:04:15.245 ************************************ 00:04:15.245 END TEST setup.sh 00:04:15.245 ************************************ 00:04:15.503 17:52:24 -- spdk/autotest.sh@128 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh status 00:04:18.791 Hugepages 00:04:18.791 node hugesize free / total 00:04:18.791 node0 1048576kB 0 / 0 00:04:18.791 node0 2048kB 2048 / 2048 00:04:18.791 node1 1048576kB 0 / 0 00:04:18.791 node1 2048kB 0 / 0 00:04:18.791 00:04:18.791 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:18.791 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:04:18.791 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:04:18.791 NVMe 0000:5f:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:04:18.791 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:04:18.791 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:04:18.791 17:52:27 -- spdk/autotest.sh@130 -- # uname -s 00:04:18.791 17:52:27 -- spdk/autotest.sh@130 -- # [[ Linux == Linux ]] 00:04:18.791 17:52:27 -- spdk/autotest.sh@132 -- # nvme_namespace_revert 00:04:18.791 17:52:27 -- common/autotest_common.sh@1527 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:21.325 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:21.325 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:24.622 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:24.622 17:52:33 -- common/autotest_common.sh@1528 -- # sleep 1 00:04:25.594 17:52:34 -- common/autotest_common.sh@1529 -- # bdfs=() 00:04:25.594 17:52:34 -- common/autotest_common.sh@1529 -- # local bdfs 00:04:25.594 17:52:34 -- common/autotest_common.sh@1530 -- # bdfs=($(get_nvme_bdfs)) 00:04:25.594 17:52:34 -- common/autotest_common.sh@1530 -- # get_nvme_bdfs 00:04:25.594 17:52:34 -- common/autotest_common.sh@1509 -- # bdfs=() 00:04:25.594 17:52:34 -- common/autotest_common.sh@1509 -- # local bdfs 00:04:25.594 17:52:34 -- common/autotest_common.sh@1510 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:25.594 17:52:34 -- common/autotest_common.sh@1510 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:25.594 17:52:34 -- common/autotest_common.sh@1510 -- # jq -r '.config[].params.traddr' 00:04:25.594 17:52:34 -- common/autotest_common.sh@1511 -- # (( 1 == 0 )) 00:04:25.594 17:52:34 -- common/autotest_common.sh@1515 -- # printf '%s\n' 0000:5f:00.0 00:04:25.594 17:52:34 -- common/autotest_common.sh@1532 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:04:28.882 Waiting for block devices as requested 00:04:28.882 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:04:28.882 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:28.882 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:29.141 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:29.142 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:29.142 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:29.400 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:29.400 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:29.400 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:29.659 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:29.659 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:29.659 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:29.919 17:52:38 -- common/autotest_common.sh@1534 -- # for bdf in "${bdfs[@]}" 00:04:29.919 17:52:38 -- common/autotest_common.sh@1535 -- # get_nvme_ctrlr_from_bdf 0000:5f:00.0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1498 -- # readlink -f /sys/class/nvme/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1498 -- # grep 0000:5f:00.0/nvme/nvme 00:04:29.919 17:52:38 -- common/autotest_common.sh@1498 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1499 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 ]] 00:04:29.919 17:52:38 -- common/autotest_common.sh@1503 -- # basename /sys/devices/pci0000:5d/0000:5d:03.0/0000:5f:00.0/nvme/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1503 -- # printf '%s\n' nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1535 -- # nvme_ctrlr=/dev/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1536 -- # [[ -z /dev/nvme0 ]] 00:04:29.919 17:52:38 -- common/autotest_common.sh@1541 -- # grep oacs 00:04:29.919 17:52:38 -- common/autotest_common.sh@1541 -- # nvme id-ctrl /dev/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1541 -- # cut -d: -f2 00:04:29.919 17:52:38 -- common/autotest_common.sh@1541 -- # oacs=' 0xe' 00:04:29.919 17:52:38 -- common/autotest_common.sh@1542 -- # oacs_ns_manage=8 00:04:29.919 17:52:38 -- common/autotest_common.sh@1544 -- # [[ 8 -ne 0 ]] 00:04:29.919 17:52:38 -- common/autotest_common.sh@1550 -- # nvme id-ctrl /dev/nvme0 00:04:29.919 17:52:38 -- common/autotest_common.sh@1550 -- # grep unvmcap 00:04:29.919 17:52:38 -- common/autotest_common.sh@1550 -- # cut -d: -f2 00:04:29.919 17:52:38 -- common/autotest_common.sh@1550 -- # unvmcap=' 0' 00:04:29.919 17:52:38 -- common/autotest_common.sh@1551 -- # [[ 0 -eq 0 ]] 00:04:29.919 17:52:38 -- common/autotest_common.sh@1553 -- # continue 00:04:29.920 17:52:38 -- spdk/autotest.sh@135 -- # timing_exit pre_cleanup 00:04:29.920 17:52:38 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:29.920 17:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:29.920 17:52:38 -- spdk/autotest.sh@138 -- # timing_enter afterboot 00:04:29.920 17:52:38 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:29.920 17:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:29.920 17:52:39 -- spdk/autotest.sh@139 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:04:33.208 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:33.208 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:36.497 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:04:36.497 17:52:45 -- spdk/autotest.sh@140 -- # timing_exit afterboot 00:04:36.497 17:52:45 -- common/autotest_common.sh@726 -- # xtrace_disable 00:04:36.497 17:52:45 -- common/autotest_common.sh@10 -- # set +x 00:04:36.497 17:52:45 -- spdk/autotest.sh@144 -- # opal_revert_cleanup 00:04:36.497 17:52:45 -- common/autotest_common.sh@1587 -- # mapfile -t bdfs 00:04:36.497 17:52:45 -- common/autotest_common.sh@1587 -- # get_nvme_bdfs_by_id 0x0a54 00:04:36.497 17:52:45 -- common/autotest_common.sh@1573 -- # bdfs=() 00:04:36.497 17:52:45 -- common/autotest_common.sh@1573 -- # local bdfs 00:04:36.498 17:52:45 -- common/autotest_common.sh@1575 -- # get_nvme_bdfs 00:04:36.498 17:52:45 -- common/autotest_common.sh@1509 -- # bdfs=() 00:04:36.498 17:52:45 -- common/autotest_common.sh@1509 -- # local bdfs 00:04:36.498 17:52:45 -- common/autotest_common.sh@1510 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:36.498 17:52:45 -- common/autotest_common.sh@1510 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:36.498 17:52:45 -- common/autotest_common.sh@1510 -- # jq -r '.config[].params.traddr' 00:04:36.498 17:52:45 -- common/autotest_common.sh@1511 -- # (( 1 == 0 )) 00:04:36.498 17:52:45 -- common/autotest_common.sh@1515 -- # printf '%s\n' 0000:5f:00.0 00:04:36.498 17:52:45 -- common/autotest_common.sh@1575 -- # for bdf in $(get_nvme_bdfs) 00:04:36.498 17:52:45 -- common/autotest_common.sh@1576 -- # cat /sys/bus/pci/devices/0000:5f:00.0/device 00:04:36.498 17:52:45 -- common/autotest_common.sh@1576 -- # device=0x0a54 00:04:36.498 17:52:45 -- common/autotest_common.sh@1577 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:36.498 17:52:45 -- common/autotest_common.sh@1578 -- # bdfs+=($bdf) 00:04:36.498 17:52:45 -- common/autotest_common.sh@1582 -- # printf '%s\n' 0000:5f:00.0 00:04:36.498 17:52:45 -- common/autotest_common.sh@1588 -- # [[ -z 0000:5f:00.0 ]] 00:04:36.498 17:52:45 -- common/autotest_common.sh@1593 -- # spdk_tgt_pid=821299 00:04:36.498 17:52:45 -- common/autotest_common.sh@1592 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:04:36.498 17:52:45 -- common/autotest_common.sh@1594 -- # waitforlisten 821299 00:04:36.498 17:52:45 -- common/autotest_common.sh@827 -- # '[' -z 821299 ']' 00:04:36.498 17:52:45 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:36.498 17:52:45 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:36.498 17:52:45 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:36.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:36.498 17:52:45 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:36.498 17:52:45 -- common/autotest_common.sh@10 -- # set +x 00:04:36.498 [2024-04-26 17:52:45.513174] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:04:36.498 [2024-04-26 17:52:45.513227] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid821299 ] 00:04:36.498 EAL: No free 2048 kB hugepages reported on node 1 00:04:36.498 [2024-04-26 17:52:45.582323] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:36.498 [2024-04-26 17:52:45.669629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:37.431 17:52:46 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:37.431 17:52:46 -- common/autotest_common.sh@860 -- # return 0 00:04:37.431 17:52:46 -- common/autotest_common.sh@1596 -- # bdf_id=0 00:04:37.431 17:52:46 -- common/autotest_common.sh@1597 -- # for bdf in "${bdfs[@]}" 00:04:37.431 17:52:46 -- common/autotest_common.sh@1598 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5f:00.0 00:04:40.710 nvme0n1 00:04:40.710 17:52:49 -- common/autotest_common.sh@1600 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:40.710 [2024-04-26 17:52:49.446696] vbdev_opal_rpc.c: 125:rpc_bdev_nvme_opal_revert: *ERROR*: nvme0 not support opal 00:04:40.710 request: 00:04:40.710 { 00:04:40.710 "nvme_ctrlr_name": "nvme0", 00:04:40.710 "password": "test", 00:04:40.710 "method": "bdev_nvme_opal_revert", 00:04:40.710 "req_id": 1 00:04:40.710 } 00:04:40.710 Got JSON-RPC error response 00:04:40.710 response: 00:04:40.710 { 00:04:40.710 "code": -32602, 00:04:40.710 "message": "Invalid parameters" 00:04:40.710 } 00:04:40.710 17:52:49 -- common/autotest_common.sh@1600 -- # true 00:04:40.710 17:52:49 -- common/autotest_common.sh@1601 -- # (( ++bdf_id )) 00:04:40.710 17:52:49 -- common/autotest_common.sh@1604 -- # killprocess 821299 00:04:40.710 17:52:49 -- common/autotest_common.sh@946 -- # '[' -z 821299 ']' 00:04:40.710 17:52:49 -- common/autotest_common.sh@950 -- # kill -0 821299 00:04:40.710 17:52:49 -- common/autotest_common.sh@951 -- # uname 00:04:40.710 17:52:49 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:40.710 17:52:49 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 821299 00:04:40.710 17:52:49 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:40.710 17:52:49 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:40.710 17:52:49 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 821299' 00:04:40.710 killing process with pid 821299 00:04:40.710 17:52:49 -- common/autotest_common.sh@965 -- # kill 821299 00:04:40.710 17:52:49 -- common/autotest_common.sh@970 -- # wait 821299 00:04:44.899 17:52:53 -- spdk/autotest.sh@150 -- # '[' 0 -eq 1 ']' 00:04:44.899 17:52:53 -- spdk/autotest.sh@154 -- # '[' 1 -eq 1 ']' 00:04:44.899 17:52:53 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:44.899 17:52:53 -- spdk/autotest.sh@155 -- # [[ 0 -eq 1 ]] 00:04:44.899 17:52:53 -- spdk/autotest.sh@162 -- # timing_enter lib 00:04:44.899 17:52:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:04:44.899 17:52:53 -- common/autotest_common.sh@10 -- # set +x 00:04:44.899 17:52:53 -- spdk/autotest.sh@164 -- # run_test env /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:44.899 17:52:53 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:44.899 17:52:53 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:44.899 17:52:53 -- common/autotest_common.sh@10 -- # set +x 00:04:44.899 ************************************ 00:04:44.899 START TEST env 00:04:44.899 ************************************ 00:04:44.899 17:52:53 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env.sh 00:04:44.899 * Looking for test storage... 00:04:44.899 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env 00:04:44.899 17:52:53 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:44.899 17:52:53 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:44.899 17:52:53 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:44.899 17:52:53 -- common/autotest_common.sh@10 -- # set +x 00:04:44.899 ************************************ 00:04:44.899 START TEST env_memory 00:04:44.899 ************************************ 00:04:44.899 17:52:53 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/memory/memory_ut 00:04:44.899 00:04:44.899 00:04:44.899 CUnit - A unit testing framework for C - Version 2.1-3 00:04:44.899 http://cunit.sourceforge.net/ 00:04:44.899 00:04:44.900 00:04:44.900 Suite: memory 00:04:44.900 Test: alloc and free memory map ...[2024-04-26 17:52:53.966411] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:44.900 passed 00:04:44.900 Test: mem map translation ...[2024-04-26 17:52:53.984825] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:44.900 [2024-04-26 17:52:53.984842] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:44.900 [2024-04-26 17:52:53.984877] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:44.900 [2024-04-26 17:52:53.984886] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:44.900 passed 00:04:44.900 Test: mem map registration ...[2024-04-26 17:52:54.020830] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:44.900 [2024-04-26 17:52:54.020858] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:44.900 passed 00:04:44.900 Test: mem map adjacent registrations ...passed 00:04:44.900 00:04:44.900 Run Summary: Type Total Ran Passed Failed Inactive 00:04:44.900 suites 1 1 n/a 0 0 00:04:44.900 tests 4 4 4 0 0 00:04:44.900 asserts 152 152 152 0 n/a 00:04:44.900 00:04:44.900 Elapsed time = 0.136 seconds 00:04:44.900 00:04:44.900 real 0m0.149s 00:04:44.900 user 0m0.139s 00:04:44.900 sys 0m0.010s 00:04:44.900 17:52:54 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:44.900 17:52:54 -- common/autotest_common.sh@10 -- # set +x 00:04:44.900 ************************************ 00:04:44.900 END TEST env_memory 00:04:44.900 ************************************ 00:04:45.159 17:52:54 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:45.159 17:52:54 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:45.159 17:52:54 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:45.159 17:52:54 -- common/autotest_common.sh@10 -- # set +x 00:04:45.159 ************************************ 00:04:45.159 START TEST env_vtophys 00:04:45.159 ************************************ 00:04:45.159 17:52:54 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:45.159 EAL: lib.eal log level changed from notice to debug 00:04:45.159 EAL: Detected lcore 0 as core 0 on socket 0 00:04:45.159 EAL: Detected lcore 1 as core 1 on socket 0 00:04:45.159 EAL: Detected lcore 2 as core 2 on socket 0 00:04:45.159 EAL: Detected lcore 3 as core 3 on socket 0 00:04:45.159 EAL: Detected lcore 4 as core 4 on socket 0 00:04:45.159 EAL: Detected lcore 5 as core 8 on socket 0 00:04:45.159 EAL: Detected lcore 6 as core 9 on socket 0 00:04:45.159 EAL: Detected lcore 7 as core 10 on socket 0 00:04:45.159 EAL: Detected lcore 8 as core 11 on socket 0 00:04:45.159 EAL: Detected lcore 9 as core 16 on socket 0 00:04:45.159 EAL: Detected lcore 10 as core 17 on socket 0 00:04:45.159 EAL: Detected lcore 11 as core 18 on socket 0 00:04:45.159 EAL: Detected lcore 12 as core 19 on socket 0 00:04:45.159 EAL: Detected lcore 13 as core 20 on socket 0 00:04:45.159 EAL: Detected lcore 14 as core 24 on socket 0 00:04:45.159 EAL: Detected lcore 15 as core 25 on socket 0 00:04:45.159 EAL: Detected lcore 16 as core 26 on socket 0 00:04:45.159 EAL: Detected lcore 17 as core 27 on socket 0 00:04:45.159 EAL: Detected lcore 18 as core 0 on socket 1 00:04:45.159 EAL: Detected lcore 19 as core 1 on socket 1 00:04:45.159 EAL: Detected lcore 20 as core 2 on socket 1 00:04:45.159 EAL: Detected lcore 21 as core 3 on socket 1 00:04:45.159 EAL: Detected lcore 22 as core 4 on socket 1 00:04:45.159 EAL: Detected lcore 23 as core 8 on socket 1 00:04:45.159 EAL: Detected lcore 24 as core 9 on socket 1 00:04:45.159 EAL: Detected lcore 25 as core 10 on socket 1 00:04:45.159 EAL: Detected lcore 26 as core 11 on socket 1 00:04:45.159 EAL: Detected lcore 27 as core 16 on socket 1 00:04:45.159 EAL: Detected lcore 28 as core 17 on socket 1 00:04:45.159 EAL: Detected lcore 29 as core 18 on socket 1 00:04:45.159 EAL: Detected lcore 30 as core 19 on socket 1 00:04:45.159 EAL: Detected lcore 31 as core 20 on socket 1 00:04:45.159 EAL: Detected lcore 32 as core 24 on socket 1 00:04:45.159 EAL: Detected lcore 33 as core 25 on socket 1 00:04:45.159 EAL: Detected lcore 34 as core 26 on socket 1 00:04:45.159 EAL: Detected lcore 35 as core 27 on socket 1 00:04:45.159 EAL: Detected lcore 36 as core 0 on socket 0 00:04:45.159 EAL: Detected lcore 37 as core 1 on socket 0 00:04:45.159 EAL: Detected lcore 38 as core 2 on socket 0 00:04:45.159 EAL: Detected lcore 39 as core 3 on socket 0 00:04:45.159 EAL: Detected lcore 40 as core 4 on socket 0 00:04:45.159 EAL: Detected lcore 41 as core 8 on socket 0 00:04:45.159 EAL: Detected lcore 42 as core 9 on socket 0 00:04:45.159 EAL: Detected lcore 43 as core 10 on socket 0 00:04:45.159 EAL: Detected lcore 44 as core 11 on socket 0 00:04:45.159 EAL: Detected lcore 45 as core 16 on socket 0 00:04:45.159 EAL: Detected lcore 46 as core 17 on socket 0 00:04:45.159 EAL: Detected lcore 47 as core 18 on socket 0 00:04:45.159 EAL: Detected lcore 48 as core 19 on socket 0 00:04:45.159 EAL: Detected lcore 49 as core 20 on socket 0 00:04:45.159 EAL: Detected lcore 50 as core 24 on socket 0 00:04:45.159 EAL: Detected lcore 51 as core 25 on socket 0 00:04:45.159 EAL: Detected lcore 52 as core 26 on socket 0 00:04:45.159 EAL: Detected lcore 53 as core 27 on socket 0 00:04:45.159 EAL: Detected lcore 54 as core 0 on socket 1 00:04:45.159 EAL: Detected lcore 55 as core 1 on socket 1 00:04:45.159 EAL: Detected lcore 56 as core 2 on socket 1 00:04:45.159 EAL: Detected lcore 57 as core 3 on socket 1 00:04:45.159 EAL: Detected lcore 58 as core 4 on socket 1 00:04:45.159 EAL: Detected lcore 59 as core 8 on socket 1 00:04:45.159 EAL: Detected lcore 60 as core 9 on socket 1 00:04:45.159 EAL: Detected lcore 61 as core 10 on socket 1 00:04:45.159 EAL: Detected lcore 62 as core 11 on socket 1 00:04:45.159 EAL: Detected lcore 63 as core 16 on socket 1 00:04:45.159 EAL: Detected lcore 64 as core 17 on socket 1 00:04:45.159 EAL: Detected lcore 65 as core 18 on socket 1 00:04:45.159 EAL: Detected lcore 66 as core 19 on socket 1 00:04:45.159 EAL: Detected lcore 67 as core 20 on socket 1 00:04:45.159 EAL: Detected lcore 68 as core 24 on socket 1 00:04:45.159 EAL: Detected lcore 69 as core 25 on socket 1 00:04:45.159 EAL: Detected lcore 70 as core 26 on socket 1 00:04:45.159 EAL: Detected lcore 71 as core 27 on socket 1 00:04:45.159 EAL: Maximum logical cores by configuration: 128 00:04:45.159 EAL: Detected CPU lcores: 72 00:04:45.159 EAL: Detected NUMA nodes: 2 00:04:45.159 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:45.159 EAL: Detected shared linkage of DPDK 00:04:45.159 EAL: No shared files mode enabled, IPC will be disabled 00:04:45.159 EAL: Bus pci wants IOVA as 'DC' 00:04:45.159 EAL: Buses did not request a specific IOVA mode. 00:04:45.159 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:45.159 EAL: Selected IOVA mode 'VA' 00:04:45.159 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.159 EAL: Probing VFIO support... 00:04:45.159 EAL: IOMMU type 1 (Type 1) is supported 00:04:45.159 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:45.159 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:45.159 EAL: VFIO support initialized 00:04:45.159 EAL: Ask a virtual area of 0x2e000 bytes 00:04:45.159 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:45.159 EAL: Setting up physically contiguous memory... 00:04:45.159 EAL: Setting maximum number of open files to 524288 00:04:45.159 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:45.159 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:45.159 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:45.159 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:45.159 EAL: Ask a virtual area of 0x61000 bytes 00:04:45.159 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:45.159 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:45.159 EAL: Ask a virtual area of 0x400000000 bytes 00:04:45.159 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:45.159 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:45.159 EAL: Hugepages will be freed exactly as allocated. 00:04:45.159 EAL: No shared files mode enabled, IPC is disabled 00:04:45.159 EAL: No shared files mode enabled, IPC is disabled 00:04:45.159 EAL: TSC frequency is ~2300000 KHz 00:04:45.159 EAL: Main lcore 0 is ready (tid=7f9dad8b4a00;cpuset=[0]) 00:04:45.159 EAL: Trying to obtain current memory policy. 00:04:45.159 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.159 EAL: Restoring previous memory policy: 0 00:04:45.159 EAL: request: mp_malloc_sync 00:04:45.159 EAL: No shared files mode enabled, IPC is disabled 00:04:45.159 EAL: Heap on socket 0 was expanded by 2MB 00:04:45.159 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:45.418 EAL: Mem event callback 'spdk:(nil)' registered 00:04:45.418 00:04:45.418 00:04:45.418 CUnit - A unit testing framework for C - Version 2.1-3 00:04:45.418 http://cunit.sourceforge.net/ 00:04:45.418 00:04:45.418 00:04:45.418 Suite: components_suite 00:04:45.418 Test: vtophys_malloc_test ...passed 00:04:45.418 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 4MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 4MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 6MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 6MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 10MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 10MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 18MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 18MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 34MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 34MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 66MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 66MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 130MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was shrunk by 130MB 00:04:45.418 EAL: Trying to obtain current memory policy. 00:04:45.418 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.418 EAL: Restoring previous memory policy: 4 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.418 EAL: request: mp_malloc_sync 00:04:45.418 EAL: No shared files mode enabled, IPC is disabled 00:04:45.418 EAL: Heap on socket 0 was expanded by 258MB 00:04:45.418 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.676 EAL: request: mp_malloc_sync 00:04:45.676 EAL: No shared files mode enabled, IPC is disabled 00:04:45.676 EAL: Heap on socket 0 was shrunk by 258MB 00:04:45.676 EAL: Trying to obtain current memory policy. 00:04:45.676 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:45.676 EAL: Restoring previous memory policy: 4 00:04:45.676 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.676 EAL: request: mp_malloc_sync 00:04:45.676 EAL: No shared files mode enabled, IPC is disabled 00:04:45.676 EAL: Heap on socket 0 was expanded by 514MB 00:04:45.676 EAL: Calling mem event callback 'spdk:(nil)' 00:04:45.934 EAL: request: mp_malloc_sync 00:04:45.934 EAL: No shared files mode enabled, IPC is disabled 00:04:45.934 EAL: Heap on socket 0 was shrunk by 514MB 00:04:45.934 EAL: Trying to obtain current memory policy. 00:04:45.934 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:46.193 EAL: Restoring previous memory policy: 4 00:04:46.193 EAL: Calling mem event callback 'spdk:(nil)' 00:04:46.193 EAL: request: mp_malloc_sync 00:04:46.193 EAL: No shared files mode enabled, IPC is disabled 00:04:46.193 EAL: Heap on socket 0 was expanded by 1026MB 00:04:46.193 EAL: Calling mem event callback 'spdk:(nil)' 00:04:46.450 EAL: request: mp_malloc_sync 00:04:46.450 EAL: No shared files mode enabled, IPC is disabled 00:04:46.450 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:46.450 passed 00:04:46.450 00:04:46.451 Run Summary: Type Total Ran Passed Failed Inactive 00:04:46.451 suites 1 1 n/a 0 0 00:04:46.451 tests 2 2 2 0 0 00:04:46.451 asserts 497 497 497 0 n/a 00:04:46.451 00:04:46.451 Elapsed time = 1.129 seconds 00:04:46.451 EAL: Calling mem event callback 'spdk:(nil)' 00:04:46.451 EAL: request: mp_malloc_sync 00:04:46.451 EAL: No shared files mode enabled, IPC is disabled 00:04:46.451 EAL: Heap on socket 0 was shrunk by 2MB 00:04:46.451 EAL: No shared files mode enabled, IPC is disabled 00:04:46.451 EAL: No shared files mode enabled, IPC is disabled 00:04:46.451 EAL: No shared files mode enabled, IPC is disabled 00:04:46.451 00:04:46.451 real 0m1.263s 00:04:46.451 user 0m0.735s 00:04:46.451 sys 0m0.497s 00:04:46.451 17:52:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:46.451 17:52:55 -- common/autotest_common.sh@10 -- # set +x 00:04:46.451 ************************************ 00:04:46.451 END TEST env_vtophys 00:04:46.451 ************************************ 00:04:46.451 17:52:55 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:46.451 17:52:55 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:46.451 17:52:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:46.451 17:52:55 -- common/autotest_common.sh@10 -- # set +x 00:04:46.709 ************************************ 00:04:46.709 START TEST env_pci 00:04:46.709 ************************************ 00:04:46.709 17:52:55 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/pci/pci_ut 00:04:46.709 00:04:46.709 00:04:46.709 CUnit - A unit testing framework for C - Version 2.1-3 00:04:46.709 http://cunit.sourceforge.net/ 00:04:46.709 00:04:46.709 00:04:46.709 Suite: pci 00:04:46.709 Test: pci_hook ...[2024-04-26 17:52:55.728756] /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 822717 has claimed it 00:04:46.709 EAL: Cannot find device (10000:00:01.0) 00:04:46.709 EAL: Failed to attach device on primary process 00:04:46.709 passed 00:04:46.709 00:04:46.709 Run Summary: Type Total Ran Passed Failed Inactive 00:04:46.709 suites 1 1 n/a 0 0 00:04:46.709 tests 1 1 1 0 0 00:04:46.709 asserts 25 25 25 0 n/a 00:04:46.709 00:04:46.709 Elapsed time = 0.034 seconds 00:04:46.709 00:04:46.709 real 0m0.056s 00:04:46.709 user 0m0.018s 00:04:46.709 sys 0m0.038s 00:04:46.709 17:52:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:46.709 17:52:55 -- common/autotest_common.sh@10 -- # set +x 00:04:46.709 ************************************ 00:04:46.709 END TEST env_pci 00:04:46.709 ************************************ 00:04:46.709 17:52:55 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:46.709 17:52:55 -- env/env.sh@15 -- # uname 00:04:46.709 17:52:55 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:46.709 17:52:55 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:46.709 17:52:55 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:46.709 17:52:55 -- common/autotest_common.sh@1097 -- # '[' 5 -le 1 ']' 00:04:46.709 17:52:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:46.709 17:52:55 -- common/autotest_common.sh@10 -- # set +x 00:04:46.968 ************************************ 00:04:46.968 START TEST env_dpdk_post_init 00:04:46.968 ************************************ 00:04:46.968 17:52:55 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:46.968 EAL: Detected CPU lcores: 72 00:04:46.968 EAL: Detected NUMA nodes: 2 00:04:46.968 EAL: Detected shared linkage of DPDK 00:04:46.968 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:46.968 EAL: Selected IOVA mode 'VA' 00:04:46.968 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.968 EAL: VFIO support initialized 00:04:46.968 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:46.968 EAL: Using IOMMU type 1 (Type 1) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:46.968 EAL: Ignore mapping IO port bar(1) 00:04:46.968 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:47.226 EAL: Ignore mapping IO port bar(1) 00:04:47.226 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:47.226 EAL: Ignore mapping IO port bar(1) 00:04:47.226 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:47.793 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5f:00.0 (socket 0) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:47.793 EAL: Ignore mapping IO port bar(1) 00:04:47.793 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:48.052 EAL: Ignore mapping IO port bar(1) 00:04:48.052 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:48.052 EAL: Ignore mapping IO port bar(1) 00:04:48.052 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:53.311 EAL: Releasing PCI mapped resource for 0000:5f:00.0 00:04:53.311 EAL: Calling pci_unmap_resource for 0000:5f:00.0 at 0x202001020000 00:04:53.569 Starting DPDK initialization... 00:04:53.569 Starting SPDK post initialization... 00:04:53.569 SPDK NVMe probe 00:04:53.569 Attaching to 0000:5f:00.0 00:04:53.569 Attached to 0000:5f:00.0 00:04:53.569 Cleaning up... 00:04:53.569 00:04:53.569 real 0m6.696s 00:04:53.569 user 0m5.092s 00:04:53.569 sys 0m0.671s 00:04:53.569 17:53:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:53.569 17:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:53.569 ************************************ 00:04:53.569 END TEST env_dpdk_post_init 00:04:53.569 ************************************ 00:04:53.569 17:53:02 -- env/env.sh@26 -- # uname 00:04:53.569 17:53:02 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:53.569 17:53:02 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:53.569 17:53:02 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:53.569 17:53:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:53.569 17:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:53.828 ************************************ 00:04:53.828 START TEST env_mem_callbacks 00:04:53.828 ************************************ 00:04:53.828 17:53:02 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:53.828 EAL: Detected CPU lcores: 72 00:04:53.828 EAL: Detected NUMA nodes: 2 00:04:53.828 EAL: Detected shared linkage of DPDK 00:04:53.828 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:53.828 EAL: Selected IOVA mode 'VA' 00:04:53.828 EAL: No free 2048 kB hugepages reported on node 1 00:04:53.828 EAL: VFIO support initialized 00:04:53.828 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:53.828 00:04:53.828 00:04:53.828 CUnit - A unit testing framework for C - Version 2.1-3 00:04:53.828 http://cunit.sourceforge.net/ 00:04:53.828 00:04:53.828 00:04:53.828 Suite: memory 00:04:53.828 Test: test ... 00:04:53.828 register 0x200000200000 2097152 00:04:53.828 malloc 3145728 00:04:53.828 register 0x200000400000 4194304 00:04:53.828 buf 0x200000500000 len 3145728 PASSED 00:04:53.828 malloc 64 00:04:53.828 buf 0x2000004fff40 len 64 PASSED 00:04:53.828 malloc 4194304 00:04:53.828 register 0x200000800000 6291456 00:04:53.828 buf 0x200000a00000 len 4194304 PASSED 00:04:53.828 free 0x200000500000 3145728 00:04:53.828 free 0x2000004fff40 64 00:04:53.828 unregister 0x200000400000 4194304 PASSED 00:04:53.828 free 0x200000a00000 4194304 00:04:53.828 unregister 0x200000800000 6291456 PASSED 00:04:53.828 malloc 8388608 00:04:53.828 register 0x200000400000 10485760 00:04:53.828 buf 0x200000600000 len 8388608 PASSED 00:04:53.828 free 0x200000600000 8388608 00:04:53.828 unregister 0x200000400000 10485760 PASSED 00:04:53.828 passed 00:04:53.828 00:04:53.828 Run Summary: Type Total Ran Passed Failed Inactive 00:04:53.828 suites 1 1 n/a 0 0 00:04:53.828 tests 1 1 1 0 0 00:04:53.828 asserts 15 15 15 0 n/a 00:04:53.828 00:04:53.828 Elapsed time = 0.005 seconds 00:04:53.828 00:04:53.828 real 0m0.067s 00:04:53.828 user 0m0.025s 00:04:53.828 sys 0m0.042s 00:04:53.828 17:53:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:53.828 17:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:53.828 ************************************ 00:04:53.828 END TEST env_mem_callbacks 00:04:53.828 ************************************ 00:04:53.828 00:04:53.828 real 0m9.289s 00:04:53.828 user 0m6.405s 00:04:53.828 sys 0m1.870s 00:04:53.828 17:53:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:53.828 17:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:53.828 ************************************ 00:04:53.828 END TEST env 00:04:53.828 ************************************ 00:04:53.828 17:53:02 -- spdk/autotest.sh@165 -- # run_test rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:53.828 17:53:02 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:53.828 17:53:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:53.828 17:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:54.086 ************************************ 00:04:54.086 START TEST rpc 00:04:54.086 ************************************ 00:04:54.086 17:53:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/rpc.sh 00:04:54.086 * Looking for test storage... 00:04:54.086 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:54.086 17:53:03 -- rpc/rpc.sh@65 -- # spdk_pid=823938 00:04:54.086 17:53:03 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:54.086 17:53:03 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:54.086 17:53:03 -- rpc/rpc.sh@67 -- # waitforlisten 823938 00:04:54.086 17:53:03 -- common/autotest_common.sh@827 -- # '[' -z 823938 ']' 00:04:54.086 17:53:03 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:54.086 17:53:03 -- common/autotest_common.sh@832 -- # local max_retries=100 00:04:54.086 17:53:03 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:54.086 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:54.086 17:53:03 -- common/autotest_common.sh@836 -- # xtrace_disable 00:04:54.086 17:53:03 -- common/autotest_common.sh@10 -- # set +x 00:04:54.086 [2024-04-26 17:53:03.274181] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:04:54.086 [2024-04-26 17:53:03.274244] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid823938 ] 00:04:54.344 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.344 [2024-04-26 17:53:03.344749] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.344 [2024-04-26 17:53:03.423097] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:54.344 [2024-04-26 17:53:03.423142] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 823938' to capture a snapshot of events at runtime. 00:04:54.344 [2024-04-26 17:53:03.423151] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:04:54.344 [2024-04-26 17:53:03.423160] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:04:54.344 [2024-04-26 17:53:03.423168] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid823938 for offline analysis/debug. 00:04:54.344 [2024-04-26 17:53:03.423191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.911 17:53:04 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:04:54.911 17:53:04 -- common/autotest_common.sh@860 -- # return 0 00:04:54.911 17:53:04 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:54.911 17:53:04 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:54.911 17:53:04 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:54.911 17:53:04 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:54.911 17:53:04 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:54.911 17:53:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:54.911 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.170 ************************************ 00:04:55.170 START TEST rpc_integrity 00:04:55.170 ************************************ 00:04:55.170 17:53:04 -- common/autotest_common.sh@1121 -- # rpc_integrity 00:04:55.170 17:53:04 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:55.170 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.170 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.170 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.170 17:53:04 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:55.170 17:53:04 -- rpc/rpc.sh@13 -- # jq length 00:04:55.170 17:53:04 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:55.170 17:53:04 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:55.170 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.170 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.170 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.170 17:53:04 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:55.170 17:53:04 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:55.170 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.170 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.170 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.170 17:53:04 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:55.170 { 00:04:55.170 "name": "Malloc0", 00:04:55.170 "aliases": [ 00:04:55.170 "c53520d6-4c3e-41ae-89a1-ac5f9bc7615a" 00:04:55.170 ], 00:04:55.170 "product_name": "Malloc disk", 00:04:55.170 "block_size": 512, 00:04:55.170 "num_blocks": 16384, 00:04:55.170 "uuid": "c53520d6-4c3e-41ae-89a1-ac5f9bc7615a", 00:04:55.170 "assigned_rate_limits": { 00:04:55.170 "rw_ios_per_sec": 0, 00:04:55.170 "rw_mbytes_per_sec": 0, 00:04:55.170 "r_mbytes_per_sec": 0, 00:04:55.170 "w_mbytes_per_sec": 0 00:04:55.170 }, 00:04:55.170 "claimed": false, 00:04:55.170 "zoned": false, 00:04:55.170 "supported_io_types": { 00:04:55.170 "read": true, 00:04:55.170 "write": true, 00:04:55.170 "unmap": true, 00:04:55.170 "write_zeroes": true, 00:04:55.170 "flush": true, 00:04:55.170 "reset": true, 00:04:55.170 "compare": false, 00:04:55.170 "compare_and_write": false, 00:04:55.170 "abort": true, 00:04:55.170 "nvme_admin": false, 00:04:55.170 "nvme_io": false 00:04:55.170 }, 00:04:55.170 "memory_domains": [ 00:04:55.170 { 00:04:55.170 "dma_device_id": "system", 00:04:55.170 "dma_device_type": 1 00:04:55.170 }, 00:04:55.170 { 00:04:55.170 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:55.170 "dma_device_type": 2 00:04:55.170 } 00:04:55.170 ], 00:04:55.170 "driver_specific": {} 00:04:55.170 } 00:04:55.170 ]' 00:04:55.170 17:53:04 -- rpc/rpc.sh@17 -- # jq length 00:04:55.170 17:53:04 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:55.170 17:53:04 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:55.170 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.170 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.170 [2024-04-26 17:53:04.348856] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:55.170 [2024-04-26 17:53:04.348890] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:55.170 [2024-04-26 17:53:04.348907] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1a19320 00:04:55.170 [2024-04-26 17:53:04.348915] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:55.170 [2024-04-26 17:53:04.350039] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:55.170 [2024-04-26 17:53:04.350062] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:55.170 Passthru0 00:04:55.170 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.170 17:53:04 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:55.170 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.170 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.429 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.429 17:53:04 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:55.429 { 00:04:55.429 "name": "Malloc0", 00:04:55.429 "aliases": [ 00:04:55.429 "c53520d6-4c3e-41ae-89a1-ac5f9bc7615a" 00:04:55.429 ], 00:04:55.429 "product_name": "Malloc disk", 00:04:55.429 "block_size": 512, 00:04:55.429 "num_blocks": 16384, 00:04:55.429 "uuid": "c53520d6-4c3e-41ae-89a1-ac5f9bc7615a", 00:04:55.429 "assigned_rate_limits": { 00:04:55.429 "rw_ios_per_sec": 0, 00:04:55.429 "rw_mbytes_per_sec": 0, 00:04:55.429 "r_mbytes_per_sec": 0, 00:04:55.429 "w_mbytes_per_sec": 0 00:04:55.429 }, 00:04:55.429 "claimed": true, 00:04:55.429 "claim_type": "exclusive_write", 00:04:55.429 "zoned": false, 00:04:55.429 "supported_io_types": { 00:04:55.429 "read": true, 00:04:55.429 "write": true, 00:04:55.429 "unmap": true, 00:04:55.429 "write_zeroes": true, 00:04:55.429 "flush": true, 00:04:55.429 "reset": true, 00:04:55.429 "compare": false, 00:04:55.429 "compare_and_write": false, 00:04:55.429 "abort": true, 00:04:55.429 "nvme_admin": false, 00:04:55.429 "nvme_io": false 00:04:55.429 }, 00:04:55.429 "memory_domains": [ 00:04:55.429 { 00:04:55.429 "dma_device_id": "system", 00:04:55.429 "dma_device_type": 1 00:04:55.429 }, 00:04:55.429 { 00:04:55.429 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:55.429 "dma_device_type": 2 00:04:55.429 } 00:04:55.429 ], 00:04:55.429 "driver_specific": {} 00:04:55.429 }, 00:04:55.429 { 00:04:55.429 "name": "Passthru0", 00:04:55.429 "aliases": [ 00:04:55.429 "e8e49141-04bd-5d4a-8848-ed442a433143" 00:04:55.429 ], 00:04:55.429 "product_name": "passthru", 00:04:55.429 "block_size": 512, 00:04:55.429 "num_blocks": 16384, 00:04:55.429 "uuid": "e8e49141-04bd-5d4a-8848-ed442a433143", 00:04:55.429 "assigned_rate_limits": { 00:04:55.429 "rw_ios_per_sec": 0, 00:04:55.429 "rw_mbytes_per_sec": 0, 00:04:55.429 "r_mbytes_per_sec": 0, 00:04:55.429 "w_mbytes_per_sec": 0 00:04:55.429 }, 00:04:55.429 "claimed": false, 00:04:55.429 "zoned": false, 00:04:55.429 "supported_io_types": { 00:04:55.429 "read": true, 00:04:55.429 "write": true, 00:04:55.429 "unmap": true, 00:04:55.429 "write_zeroes": true, 00:04:55.429 "flush": true, 00:04:55.429 "reset": true, 00:04:55.429 "compare": false, 00:04:55.429 "compare_and_write": false, 00:04:55.429 "abort": true, 00:04:55.429 "nvme_admin": false, 00:04:55.429 "nvme_io": false 00:04:55.429 }, 00:04:55.429 "memory_domains": [ 00:04:55.429 { 00:04:55.429 "dma_device_id": "system", 00:04:55.429 "dma_device_type": 1 00:04:55.429 }, 00:04:55.429 { 00:04:55.429 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:55.429 "dma_device_type": 2 00:04:55.429 } 00:04:55.429 ], 00:04:55.429 "driver_specific": { 00:04:55.429 "passthru": { 00:04:55.429 "name": "Passthru0", 00:04:55.429 "base_bdev_name": "Malloc0" 00:04:55.429 } 00:04:55.429 } 00:04:55.429 } 00:04:55.429 ]' 00:04:55.429 17:53:04 -- rpc/rpc.sh@21 -- # jq length 00:04:55.429 17:53:04 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:55.429 17:53:04 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:55.429 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.429 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.429 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.429 17:53:04 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:55.429 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.429 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.429 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.429 17:53:04 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:55.429 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.429 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.429 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.429 17:53:04 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:55.429 17:53:04 -- rpc/rpc.sh@26 -- # jq length 00:04:55.429 17:53:04 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:55.429 00:04:55.429 real 0m0.274s 00:04:55.429 user 0m0.156s 00:04:55.429 sys 0m0.052s 00:04:55.429 17:53:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:55.429 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.429 ************************************ 00:04:55.429 END TEST rpc_integrity 00:04:55.429 ************************************ 00:04:55.429 17:53:04 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:55.429 17:53:04 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:55.429 17:53:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:55.429 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.688 ************************************ 00:04:55.688 START TEST rpc_plugins 00:04:55.688 ************************************ 00:04:55.688 17:53:04 -- common/autotest_common.sh@1121 -- # rpc_plugins 00:04:55.688 17:53:04 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:55.688 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.688 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.688 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.688 17:53:04 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:55.688 17:53:04 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:55.688 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.688 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.688 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.688 17:53:04 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:55.688 { 00:04:55.688 "name": "Malloc1", 00:04:55.688 "aliases": [ 00:04:55.688 "00ca2647-7ac5-45ad-afca-2a4257bff19f" 00:04:55.688 ], 00:04:55.688 "product_name": "Malloc disk", 00:04:55.688 "block_size": 4096, 00:04:55.688 "num_blocks": 256, 00:04:55.688 "uuid": "00ca2647-7ac5-45ad-afca-2a4257bff19f", 00:04:55.688 "assigned_rate_limits": { 00:04:55.688 "rw_ios_per_sec": 0, 00:04:55.688 "rw_mbytes_per_sec": 0, 00:04:55.688 "r_mbytes_per_sec": 0, 00:04:55.688 "w_mbytes_per_sec": 0 00:04:55.688 }, 00:04:55.688 "claimed": false, 00:04:55.688 "zoned": false, 00:04:55.688 "supported_io_types": { 00:04:55.688 "read": true, 00:04:55.688 "write": true, 00:04:55.688 "unmap": true, 00:04:55.688 "write_zeroes": true, 00:04:55.688 "flush": true, 00:04:55.688 "reset": true, 00:04:55.688 "compare": false, 00:04:55.688 "compare_and_write": false, 00:04:55.688 "abort": true, 00:04:55.688 "nvme_admin": false, 00:04:55.688 "nvme_io": false 00:04:55.688 }, 00:04:55.688 "memory_domains": [ 00:04:55.688 { 00:04:55.688 "dma_device_id": "system", 00:04:55.688 "dma_device_type": 1 00:04:55.688 }, 00:04:55.688 { 00:04:55.688 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:55.688 "dma_device_type": 2 00:04:55.688 } 00:04:55.688 ], 00:04:55.688 "driver_specific": {} 00:04:55.688 } 00:04:55.688 ]' 00:04:55.688 17:53:04 -- rpc/rpc.sh@32 -- # jq length 00:04:55.688 17:53:04 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:55.688 17:53:04 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:55.688 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.688 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.688 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.688 17:53:04 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:55.688 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.688 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.688 17:53:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.688 17:53:04 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:55.689 17:53:04 -- rpc/rpc.sh@36 -- # jq length 00:04:55.689 17:53:04 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:55.689 00:04:55.689 real 0m0.139s 00:04:55.689 user 0m0.082s 00:04:55.689 sys 0m0.022s 00:04:55.689 17:53:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:55.689 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.689 ************************************ 00:04:55.689 END TEST rpc_plugins 00:04:55.689 ************************************ 00:04:55.689 17:53:04 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:55.689 17:53:04 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:55.689 17:53:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:55.689 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.947 ************************************ 00:04:55.947 START TEST rpc_trace_cmd_test 00:04:55.947 ************************************ 00:04:55.947 17:53:04 -- common/autotest_common.sh@1121 -- # rpc_trace_cmd_test 00:04:55.947 17:53:04 -- rpc/rpc.sh@40 -- # local info 00:04:55.947 17:53:04 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:55.947 17:53:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:55.947 17:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:55.947 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:55.947 17:53:05 -- rpc/rpc.sh@42 -- # info='{ 00:04:55.947 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid823938", 00:04:55.947 "tpoint_group_mask": "0x8", 00:04:55.947 "iscsi_conn": { 00:04:55.947 "mask": "0x2", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "scsi": { 00:04:55.947 "mask": "0x4", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "bdev": { 00:04:55.947 "mask": "0x8", 00:04:55.947 "tpoint_mask": "0xffffffffffffffff" 00:04:55.947 }, 00:04:55.947 "nvmf_rdma": { 00:04:55.947 "mask": "0x10", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "nvmf_tcp": { 00:04:55.947 "mask": "0x20", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "ftl": { 00:04:55.947 "mask": "0x40", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "blobfs": { 00:04:55.947 "mask": "0x80", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "dsa": { 00:04:55.947 "mask": "0x200", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "thread": { 00:04:55.947 "mask": "0x400", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "nvme_pcie": { 00:04:55.947 "mask": "0x800", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "iaa": { 00:04:55.947 "mask": "0x1000", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "nvme_tcp": { 00:04:55.947 "mask": "0x2000", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "bdev_nvme": { 00:04:55.947 "mask": "0x4000", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 }, 00:04:55.947 "sock": { 00:04:55.947 "mask": "0x8000", 00:04:55.947 "tpoint_mask": "0x0" 00:04:55.947 } 00:04:55.947 }' 00:04:55.947 17:53:05 -- rpc/rpc.sh@43 -- # jq length 00:04:55.947 17:53:05 -- rpc/rpc.sh@43 -- # '[' 16 -gt 2 ']' 00:04:55.947 17:53:05 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:55.947 17:53:05 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:55.947 17:53:05 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:55.947 17:53:05 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:56.206 17:53:05 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:56.206 17:53:05 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:56.206 17:53:05 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:56.206 17:53:05 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:56.206 00:04:56.206 real 0m0.215s 00:04:56.206 user 0m0.180s 00:04:56.206 sys 0m0.029s 00:04:56.206 17:53:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:56.206 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.206 ************************************ 00:04:56.206 END TEST rpc_trace_cmd_test 00:04:56.206 ************************************ 00:04:56.206 17:53:05 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:56.206 17:53:05 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:56.206 17:53:05 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:56.206 17:53:05 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:56.206 17:53:05 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:56.206 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 ************************************ 00:04:56.464 START TEST rpc_daemon_integrity 00:04:56.464 ************************************ 00:04:56.464 17:53:05 -- common/autotest_common.sh@1121 -- # rpc_integrity 00:04:56.464 17:53:05 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:56.464 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.464 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.464 17:53:05 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:56.464 17:53:05 -- rpc/rpc.sh@13 -- # jq length 00:04:56.464 17:53:05 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:56.464 17:53:05 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:56.464 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.464 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.464 17:53:05 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:56.464 17:53:05 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:56.464 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.464 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.464 17:53:05 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:56.464 { 00:04:56.464 "name": "Malloc2", 00:04:56.464 "aliases": [ 00:04:56.464 "df145d37-dff0-4300-8bbb-a1ea570da24d" 00:04:56.464 ], 00:04:56.464 "product_name": "Malloc disk", 00:04:56.464 "block_size": 512, 00:04:56.464 "num_blocks": 16384, 00:04:56.464 "uuid": "df145d37-dff0-4300-8bbb-a1ea570da24d", 00:04:56.464 "assigned_rate_limits": { 00:04:56.464 "rw_ios_per_sec": 0, 00:04:56.464 "rw_mbytes_per_sec": 0, 00:04:56.464 "r_mbytes_per_sec": 0, 00:04:56.464 "w_mbytes_per_sec": 0 00:04:56.464 }, 00:04:56.464 "claimed": false, 00:04:56.464 "zoned": false, 00:04:56.464 "supported_io_types": { 00:04:56.464 "read": true, 00:04:56.464 "write": true, 00:04:56.464 "unmap": true, 00:04:56.464 "write_zeroes": true, 00:04:56.464 "flush": true, 00:04:56.464 "reset": true, 00:04:56.464 "compare": false, 00:04:56.464 "compare_and_write": false, 00:04:56.464 "abort": true, 00:04:56.464 "nvme_admin": false, 00:04:56.464 "nvme_io": false 00:04:56.464 }, 00:04:56.464 "memory_domains": [ 00:04:56.464 { 00:04:56.464 "dma_device_id": "system", 00:04:56.464 "dma_device_type": 1 00:04:56.464 }, 00:04:56.464 { 00:04:56.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:56.464 "dma_device_type": 2 00:04:56.464 } 00:04:56.464 ], 00:04:56.464 "driver_specific": {} 00:04:56.464 } 00:04:56.464 ]' 00:04:56.464 17:53:05 -- rpc/rpc.sh@17 -- # jq length 00:04:56.464 17:53:05 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:56.464 17:53:05 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:56.464 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.464 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 [2024-04-26 17:53:05.540076] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:56.464 [2024-04-26 17:53:05.540113] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:56.464 [2024-04-26 17:53:05.540133] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1a190a0 00:04:56.464 [2024-04-26 17:53:05.540141] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:56.464 [2024-04-26 17:53:05.541113] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:56.464 [2024-04-26 17:53:05.541139] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:56.464 Passthru0 00:04:56.464 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.464 17:53:05 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:56.464 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.464 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.464 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.464 17:53:05 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:56.464 { 00:04:56.464 "name": "Malloc2", 00:04:56.464 "aliases": [ 00:04:56.464 "df145d37-dff0-4300-8bbb-a1ea570da24d" 00:04:56.464 ], 00:04:56.464 "product_name": "Malloc disk", 00:04:56.464 "block_size": 512, 00:04:56.464 "num_blocks": 16384, 00:04:56.464 "uuid": "df145d37-dff0-4300-8bbb-a1ea570da24d", 00:04:56.464 "assigned_rate_limits": { 00:04:56.464 "rw_ios_per_sec": 0, 00:04:56.464 "rw_mbytes_per_sec": 0, 00:04:56.464 "r_mbytes_per_sec": 0, 00:04:56.464 "w_mbytes_per_sec": 0 00:04:56.464 }, 00:04:56.464 "claimed": true, 00:04:56.464 "claim_type": "exclusive_write", 00:04:56.464 "zoned": false, 00:04:56.464 "supported_io_types": { 00:04:56.464 "read": true, 00:04:56.464 "write": true, 00:04:56.464 "unmap": true, 00:04:56.464 "write_zeroes": true, 00:04:56.464 "flush": true, 00:04:56.464 "reset": true, 00:04:56.464 "compare": false, 00:04:56.464 "compare_and_write": false, 00:04:56.464 "abort": true, 00:04:56.464 "nvme_admin": false, 00:04:56.464 "nvme_io": false 00:04:56.464 }, 00:04:56.464 "memory_domains": [ 00:04:56.464 { 00:04:56.464 "dma_device_id": "system", 00:04:56.464 "dma_device_type": 1 00:04:56.464 }, 00:04:56.464 { 00:04:56.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:56.464 "dma_device_type": 2 00:04:56.464 } 00:04:56.464 ], 00:04:56.464 "driver_specific": {} 00:04:56.464 }, 00:04:56.464 { 00:04:56.464 "name": "Passthru0", 00:04:56.464 "aliases": [ 00:04:56.464 "bf6bb255-bb10-5fc8-8a4d-8ef0be13b468" 00:04:56.464 ], 00:04:56.464 "product_name": "passthru", 00:04:56.464 "block_size": 512, 00:04:56.464 "num_blocks": 16384, 00:04:56.464 "uuid": "bf6bb255-bb10-5fc8-8a4d-8ef0be13b468", 00:04:56.464 "assigned_rate_limits": { 00:04:56.464 "rw_ios_per_sec": 0, 00:04:56.464 "rw_mbytes_per_sec": 0, 00:04:56.464 "r_mbytes_per_sec": 0, 00:04:56.464 "w_mbytes_per_sec": 0 00:04:56.464 }, 00:04:56.464 "claimed": false, 00:04:56.464 "zoned": false, 00:04:56.464 "supported_io_types": { 00:04:56.464 "read": true, 00:04:56.464 "write": true, 00:04:56.464 "unmap": true, 00:04:56.464 "write_zeroes": true, 00:04:56.464 "flush": true, 00:04:56.464 "reset": true, 00:04:56.464 "compare": false, 00:04:56.464 "compare_and_write": false, 00:04:56.464 "abort": true, 00:04:56.464 "nvme_admin": false, 00:04:56.464 "nvme_io": false 00:04:56.464 }, 00:04:56.464 "memory_domains": [ 00:04:56.464 { 00:04:56.464 "dma_device_id": "system", 00:04:56.464 "dma_device_type": 1 00:04:56.464 }, 00:04:56.464 { 00:04:56.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:56.464 "dma_device_type": 2 00:04:56.464 } 00:04:56.464 ], 00:04:56.464 "driver_specific": { 00:04:56.464 "passthru": { 00:04:56.464 "name": "Passthru0", 00:04:56.464 "base_bdev_name": "Malloc2" 00:04:56.464 } 00:04:56.464 } 00:04:56.464 } 00:04:56.464 ]' 00:04:56.464 17:53:05 -- rpc/rpc.sh@21 -- # jq length 00:04:56.464 17:53:05 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:56.465 17:53:05 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:56.465 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.465 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.465 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.465 17:53:05 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:56.465 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.465 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.465 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.465 17:53:05 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:56.465 17:53:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:04:56.465 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.465 17:53:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:04:56.465 17:53:05 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:56.465 17:53:05 -- rpc/rpc.sh@26 -- # jq length 00:04:56.723 17:53:05 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:56.723 00:04:56.723 real 0m0.281s 00:04:56.723 user 0m0.168s 00:04:56.723 sys 0m0.053s 00:04:56.723 17:53:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:56.723 17:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:56.723 ************************************ 00:04:56.723 END TEST rpc_daemon_integrity 00:04:56.723 ************************************ 00:04:56.723 17:53:05 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:56.723 17:53:05 -- rpc/rpc.sh@84 -- # killprocess 823938 00:04:56.723 17:53:05 -- common/autotest_common.sh@946 -- # '[' -z 823938 ']' 00:04:56.723 17:53:05 -- common/autotest_common.sh@950 -- # kill -0 823938 00:04:56.723 17:53:05 -- common/autotest_common.sh@951 -- # uname 00:04:56.723 17:53:05 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:04:56.723 17:53:05 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 823938 00:04:56.723 17:53:05 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:04:56.723 17:53:05 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:04:56.723 17:53:05 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 823938' 00:04:56.723 killing process with pid 823938 00:04:56.723 17:53:05 -- common/autotest_common.sh@965 -- # kill 823938 00:04:56.723 17:53:05 -- common/autotest_common.sh@970 -- # wait 823938 00:04:56.982 00:04:56.982 real 0m3.026s 00:04:56.982 user 0m3.785s 00:04:56.982 sys 0m1.033s 00:04:56.982 17:53:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:04:56.982 17:53:06 -- common/autotest_common.sh@10 -- # set +x 00:04:56.982 ************************************ 00:04:56.982 END TEST rpc 00:04:56.982 ************************************ 00:04:57.274 17:53:06 -- spdk/autotest.sh@166 -- # run_test skip_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:57.274 17:53:06 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:57.274 17:53:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:57.274 17:53:06 -- common/autotest_common.sh@10 -- # set +x 00:04:57.274 ************************************ 00:04:57.274 START TEST skip_rpc 00:04:57.274 ************************************ 00:04:57.274 17:53:06 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/skip_rpc.sh 00:04:57.274 * Looking for test storage... 00:04:57.274 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc 00:04:57.274 17:53:06 -- rpc/skip_rpc.sh@11 -- # CONFIG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:04:57.274 17:53:06 -- rpc/skip_rpc.sh@12 -- # LOG_PATH=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:04:57.274 17:53:06 -- rpc/skip_rpc.sh@73 -- # run_test skip_rpc test_skip_rpc 00:04:57.274 17:53:06 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:04:57.274 17:53:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:04:57.274 17:53:06 -- common/autotest_common.sh@10 -- # set +x 00:04:57.605 ************************************ 00:04:57.605 START TEST skip_rpc 00:04:57.605 ************************************ 00:04:57.605 17:53:06 -- common/autotest_common.sh@1121 -- # test_skip_rpc 00:04:57.605 17:53:06 -- rpc/skip_rpc.sh@16 -- # local spdk_pid=824526 00:04:57.605 17:53:06 -- rpc/skip_rpc.sh@18 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:57.605 17:53:06 -- rpc/skip_rpc.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 00:04:57.605 17:53:06 -- rpc/skip_rpc.sh@19 -- # sleep 5 00:04:57.605 [2024-04-26 17:53:06.616576] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:04:57.605 [2024-04-26 17:53:06.616622] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid824526 ] 00:04:57.605 EAL: No free 2048 kB hugepages reported on node 1 00:04:57.605 [2024-04-26 17:53:06.688331] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:57.605 [2024-04-26 17:53:06.777299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.883 17:53:11 -- rpc/skip_rpc.sh@21 -- # NOT rpc_cmd spdk_get_version 00:05:02.883 17:53:11 -- common/autotest_common.sh@648 -- # local es=0 00:05:02.883 17:53:11 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd spdk_get_version 00:05:02.883 17:53:11 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:05:02.883 17:53:11 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:02.883 17:53:11 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:05:02.883 17:53:11 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:02.883 17:53:11 -- common/autotest_common.sh@651 -- # rpc_cmd spdk_get_version 00:05:02.883 17:53:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:02.883 17:53:11 -- common/autotest_common.sh@10 -- # set +x 00:05:02.883 17:53:11 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:05:02.883 17:53:11 -- common/autotest_common.sh@651 -- # es=1 00:05:02.883 17:53:11 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:02.883 17:53:11 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:02.883 17:53:11 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:02.883 17:53:11 -- rpc/skip_rpc.sh@22 -- # trap - SIGINT SIGTERM EXIT 00:05:02.883 17:53:11 -- rpc/skip_rpc.sh@23 -- # killprocess 824526 00:05:02.883 17:53:11 -- common/autotest_common.sh@946 -- # '[' -z 824526 ']' 00:05:02.883 17:53:11 -- common/autotest_common.sh@950 -- # kill -0 824526 00:05:02.883 17:53:11 -- common/autotest_common.sh@951 -- # uname 00:05:02.883 17:53:11 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:02.883 17:53:11 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 824526 00:05:02.883 17:53:11 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:02.883 17:53:11 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:02.883 17:53:11 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 824526' 00:05:02.883 killing process with pid 824526 00:05:02.883 17:53:11 -- common/autotest_common.sh@965 -- # kill 824526 00:05:02.883 17:53:11 -- common/autotest_common.sh@970 -- # wait 824526 00:05:02.883 00:05:02.883 real 0m5.453s 00:05:02.883 user 0m5.156s 00:05:02.883 sys 0m0.321s 00:05:02.883 17:53:12 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:02.883 17:53:12 -- common/autotest_common.sh@10 -- # set +x 00:05:02.883 ************************************ 00:05:02.883 END TEST skip_rpc 00:05:02.883 ************************************ 00:05:02.883 17:53:12 -- rpc/skip_rpc.sh@74 -- # run_test skip_rpc_with_json test_skip_rpc_with_json 00:05:02.884 17:53:12 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:02.884 17:53:12 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:02.884 17:53:12 -- common/autotest_common.sh@10 -- # set +x 00:05:03.143 ************************************ 00:05:03.143 START TEST skip_rpc_with_json 00:05:03.143 ************************************ 00:05:03.143 17:53:12 -- common/autotest_common.sh@1121 -- # test_skip_rpc_with_json 00:05:03.143 17:53:12 -- rpc/skip_rpc.sh@44 -- # gen_json_config 00:05:03.143 17:53:12 -- rpc/skip_rpc.sh@28 -- # local spdk_pid=825296 00:05:03.143 17:53:12 -- rpc/skip_rpc.sh@30 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:03.143 17:53:12 -- rpc/skip_rpc.sh@31 -- # waitforlisten 825296 00:05:03.143 17:53:12 -- common/autotest_common.sh@827 -- # '[' -z 825296 ']' 00:05:03.143 17:53:12 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:03.143 17:53:12 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:03.143 17:53:12 -- rpc/skip_rpc.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:03.143 17:53:12 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:03.143 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:03.143 17:53:12 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:03.143 17:53:12 -- common/autotest_common.sh@10 -- # set +x 00:05:03.143 [2024-04-26 17:53:12.248835] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:03.143 [2024-04-26 17:53:12.248889] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid825296 ] 00:05:03.143 EAL: No free 2048 kB hugepages reported on node 1 00:05:03.143 [2024-04-26 17:53:12.318955] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:03.402 [2024-04-26 17:53:12.407890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:03.969 17:53:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:03.969 17:53:13 -- common/autotest_common.sh@860 -- # return 0 00:05:03.969 17:53:13 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_get_transports --trtype tcp 00:05:03.969 17:53:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:03.969 17:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:03.969 [2024-04-26 17:53:13.051983] nvmf_rpc.c:2513:rpc_nvmf_get_transports: *ERROR*: transport 'tcp' does not exist 00:05:03.969 request: 00:05:03.969 { 00:05:03.969 "trtype": "tcp", 00:05:03.969 "method": "nvmf_get_transports", 00:05:03.969 "req_id": 1 00:05:03.969 } 00:05:03.969 Got JSON-RPC error response 00:05:03.969 response: 00:05:03.969 { 00:05:03.969 "code": -19, 00:05:03.969 "message": "No such device" 00:05:03.969 } 00:05:03.969 17:53:13 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:05:03.969 17:53:13 -- rpc/skip_rpc.sh@34 -- # rpc_cmd nvmf_create_transport -t tcp 00:05:03.969 17:53:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:03.969 17:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:03.969 [2024-04-26 17:53:13.060078] tcp.c: 669:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:03.969 17:53:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:03.969 17:53:13 -- rpc/skip_rpc.sh@36 -- # rpc_cmd save_config 00:05:03.969 17:53:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:03.969 17:53:13 -- common/autotest_common.sh@10 -- # set +x 00:05:04.228 17:53:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:04.228 17:53:13 -- rpc/skip_rpc.sh@37 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:04.228 { 00:05:04.228 "subsystems": [ 00:05:04.228 { 00:05:04.228 "subsystem": "keyring", 00:05:04.228 "config": [] 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "subsystem": "iobuf", 00:05:04.228 "config": [ 00:05:04.228 { 00:05:04.228 "method": "iobuf_set_options", 00:05:04.228 "params": { 00:05:04.228 "small_pool_count": 8192, 00:05:04.228 "large_pool_count": 1024, 00:05:04.228 "small_bufsize": 8192, 00:05:04.228 "large_bufsize": 135168 00:05:04.228 } 00:05:04.228 } 00:05:04.228 ] 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "subsystem": "sock", 00:05:04.228 "config": [ 00:05:04.228 { 00:05:04.228 "method": "sock_impl_set_options", 00:05:04.228 "params": { 00:05:04.228 "impl_name": "posix", 00:05:04.228 "recv_buf_size": 2097152, 00:05:04.228 "send_buf_size": 2097152, 00:05:04.228 "enable_recv_pipe": true, 00:05:04.228 "enable_quickack": false, 00:05:04.228 "enable_placement_id": 0, 00:05:04.228 "enable_zerocopy_send_server": true, 00:05:04.228 "enable_zerocopy_send_client": false, 00:05:04.228 "zerocopy_threshold": 0, 00:05:04.228 "tls_version": 0, 00:05:04.228 "enable_ktls": false 00:05:04.228 } 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "method": "sock_impl_set_options", 00:05:04.228 "params": { 00:05:04.228 "impl_name": "ssl", 00:05:04.228 "recv_buf_size": 4096, 00:05:04.228 "send_buf_size": 4096, 00:05:04.228 "enable_recv_pipe": true, 00:05:04.228 "enable_quickack": false, 00:05:04.228 "enable_placement_id": 0, 00:05:04.228 "enable_zerocopy_send_server": true, 00:05:04.228 "enable_zerocopy_send_client": false, 00:05:04.228 "zerocopy_threshold": 0, 00:05:04.228 "tls_version": 0, 00:05:04.228 "enable_ktls": false 00:05:04.228 } 00:05:04.228 } 00:05:04.228 ] 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "subsystem": "vmd", 00:05:04.228 "config": [] 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "subsystem": "accel", 00:05:04.228 "config": [ 00:05:04.228 { 00:05:04.228 "method": "accel_set_options", 00:05:04.228 "params": { 00:05:04.228 "small_cache_size": 128, 00:05:04.228 "large_cache_size": 16, 00:05:04.228 "task_count": 2048, 00:05:04.228 "sequence_count": 2048, 00:05:04.228 "buf_count": 2048 00:05:04.228 } 00:05:04.228 } 00:05:04.228 ] 00:05:04.228 }, 00:05:04.228 { 00:05:04.228 "subsystem": "bdev", 00:05:04.228 "config": [ 00:05:04.228 { 00:05:04.229 "method": "bdev_set_options", 00:05:04.229 "params": { 00:05:04.229 "bdev_io_pool_size": 65535, 00:05:04.229 "bdev_io_cache_size": 256, 00:05:04.229 "bdev_auto_examine": true, 00:05:04.229 "iobuf_small_cache_size": 128, 00:05:04.229 "iobuf_large_cache_size": 16 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "bdev_raid_set_options", 00:05:04.229 "params": { 00:05:04.229 "process_window_size_kb": 1024 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "bdev_iscsi_set_options", 00:05:04.229 "params": { 00:05:04.229 "timeout_sec": 30 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "bdev_nvme_set_options", 00:05:04.229 "params": { 00:05:04.229 "action_on_timeout": "none", 00:05:04.229 "timeout_us": 0, 00:05:04.229 "timeout_admin_us": 0, 00:05:04.229 "keep_alive_timeout_ms": 10000, 00:05:04.229 "arbitration_burst": 0, 00:05:04.229 "low_priority_weight": 0, 00:05:04.229 "medium_priority_weight": 0, 00:05:04.229 "high_priority_weight": 0, 00:05:04.229 "nvme_adminq_poll_period_us": 10000, 00:05:04.229 "nvme_ioq_poll_period_us": 0, 00:05:04.229 "io_queue_requests": 0, 00:05:04.229 "delay_cmd_submit": true, 00:05:04.229 "transport_retry_count": 4, 00:05:04.229 "bdev_retry_count": 3, 00:05:04.229 "transport_ack_timeout": 0, 00:05:04.229 "ctrlr_loss_timeout_sec": 0, 00:05:04.229 "reconnect_delay_sec": 0, 00:05:04.229 "fast_io_fail_timeout_sec": 0, 00:05:04.229 "disable_auto_failback": false, 00:05:04.229 "generate_uuids": false, 00:05:04.229 "transport_tos": 0, 00:05:04.229 "nvme_error_stat": false, 00:05:04.229 "rdma_srq_size": 0, 00:05:04.229 "io_path_stat": false, 00:05:04.229 "allow_accel_sequence": false, 00:05:04.229 "rdma_max_cq_size": 0, 00:05:04.229 "rdma_cm_event_timeout_ms": 0, 00:05:04.229 "dhchap_digests": [ 00:05:04.229 "sha256", 00:05:04.229 "sha384", 00:05:04.229 "sha512" 00:05:04.229 ], 00:05:04.229 "dhchap_dhgroups": [ 00:05:04.229 "null", 00:05:04.229 "ffdhe2048", 00:05:04.229 "ffdhe3072", 00:05:04.229 "ffdhe4096", 00:05:04.229 "ffdhe6144", 00:05:04.229 "ffdhe8192" 00:05:04.229 ] 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "bdev_nvme_set_hotplug", 00:05:04.229 "params": { 00:05:04.229 "period_us": 100000, 00:05:04.229 "enable": false 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "bdev_wait_for_examine" 00:05:04.229 } 00:05:04.229 ] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "scsi", 00:05:04.229 "config": null 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "scheduler", 00:05:04.229 "config": [ 00:05:04.229 { 00:05:04.229 "method": "framework_set_scheduler", 00:05:04.229 "params": { 00:05:04.229 "name": "static" 00:05:04.229 } 00:05:04.229 } 00:05:04.229 ] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "vhost_scsi", 00:05:04.229 "config": [] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "vhost_blk", 00:05:04.229 "config": [] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "ublk", 00:05:04.229 "config": [] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "nbd", 00:05:04.229 "config": [] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "nvmf", 00:05:04.229 "config": [ 00:05:04.229 { 00:05:04.229 "method": "nvmf_set_config", 00:05:04.229 "params": { 00:05:04.229 "discovery_filter": "match_any", 00:05:04.229 "admin_cmd_passthru": { 00:05:04.229 "identify_ctrlr": false 00:05:04.229 } 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "nvmf_set_max_subsystems", 00:05:04.229 "params": { 00:05:04.229 "max_subsystems": 1024 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "nvmf_set_crdt", 00:05:04.229 "params": { 00:05:04.229 "crdt1": 0, 00:05:04.229 "crdt2": 0, 00:05:04.229 "crdt3": 0 00:05:04.229 } 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "method": "nvmf_create_transport", 00:05:04.229 "params": { 00:05:04.229 "trtype": "TCP", 00:05:04.229 "max_queue_depth": 128, 00:05:04.229 "max_io_qpairs_per_ctrlr": 127, 00:05:04.229 "in_capsule_data_size": 4096, 00:05:04.229 "max_io_size": 131072, 00:05:04.229 "io_unit_size": 131072, 00:05:04.229 "max_aq_depth": 128, 00:05:04.229 "num_shared_buffers": 511, 00:05:04.229 "buf_cache_size": 4294967295, 00:05:04.229 "dif_insert_or_strip": false, 00:05:04.229 "zcopy": false, 00:05:04.229 "c2h_success": true, 00:05:04.229 "sock_priority": 0, 00:05:04.229 "abort_timeout_sec": 1, 00:05:04.229 "ack_timeout": 0, 00:05:04.229 "data_wr_pool_size": 0 00:05:04.229 } 00:05:04.229 } 00:05:04.229 ] 00:05:04.229 }, 00:05:04.229 { 00:05:04.229 "subsystem": "iscsi", 00:05:04.229 "config": [ 00:05:04.229 { 00:05:04.229 "method": "iscsi_set_options", 00:05:04.229 "params": { 00:05:04.229 "node_base": "iqn.2016-06.io.spdk", 00:05:04.229 "max_sessions": 128, 00:05:04.229 "max_connections_per_session": 2, 00:05:04.229 "max_queue_depth": 64, 00:05:04.229 "default_time2wait": 2, 00:05:04.229 "default_time2retain": 20, 00:05:04.229 "first_burst_length": 8192, 00:05:04.229 "immediate_data": true, 00:05:04.229 "allow_duplicated_isid": false, 00:05:04.229 "error_recovery_level": 0, 00:05:04.229 "nop_timeout": 60, 00:05:04.229 "nop_in_interval": 30, 00:05:04.229 "disable_chap": false, 00:05:04.229 "require_chap": false, 00:05:04.229 "mutual_chap": false, 00:05:04.229 "chap_group": 0, 00:05:04.229 "max_large_datain_per_connection": 64, 00:05:04.229 "max_r2t_per_connection": 4, 00:05:04.229 "pdu_pool_size": 36864, 00:05:04.229 "immediate_data_pool_size": 16384, 00:05:04.229 "data_out_pool_size": 2048 00:05:04.229 } 00:05:04.229 } 00:05:04.229 ] 00:05:04.229 } 00:05:04.229 ] 00:05:04.229 } 00:05:04.229 17:53:13 -- rpc/skip_rpc.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:05:04.229 17:53:13 -- rpc/skip_rpc.sh@40 -- # killprocess 825296 00:05:04.229 17:53:13 -- common/autotest_common.sh@946 -- # '[' -z 825296 ']' 00:05:04.229 17:53:13 -- common/autotest_common.sh@950 -- # kill -0 825296 00:05:04.229 17:53:13 -- common/autotest_common.sh@951 -- # uname 00:05:04.229 17:53:13 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:04.229 17:53:13 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 825296 00:05:04.229 17:53:13 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:04.229 17:53:13 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:04.229 17:53:13 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 825296' 00:05:04.229 killing process with pid 825296 00:05:04.229 17:53:13 -- common/autotest_common.sh@965 -- # kill 825296 00:05:04.229 17:53:13 -- common/autotest_common.sh@970 -- # wait 825296 00:05:04.488 17:53:13 -- rpc/skip_rpc.sh@47 -- # local spdk_pid=825484 00:05:04.488 17:53:13 -- rpc/skip_rpc.sh@48 -- # sleep 5 00:05:04.488 17:53:13 -- rpc/skip_rpc.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:09.756 17:53:18 -- rpc/skip_rpc.sh@50 -- # killprocess 825484 00:05:09.756 17:53:18 -- common/autotest_common.sh@946 -- # '[' -z 825484 ']' 00:05:09.756 17:53:18 -- common/autotest_common.sh@950 -- # kill -0 825484 00:05:09.756 17:53:18 -- common/autotest_common.sh@951 -- # uname 00:05:09.756 17:53:18 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:09.756 17:53:18 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 825484 00:05:09.756 17:53:18 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:09.756 17:53:18 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:09.756 17:53:18 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 825484' 00:05:09.756 killing process with pid 825484 00:05:09.756 17:53:18 -- common/autotest_common.sh@965 -- # kill 825484 00:05:09.756 17:53:18 -- common/autotest_common.sh@970 -- # wait 825484 00:05:10.014 17:53:19 -- rpc/skip_rpc.sh@51 -- # grep -q 'TCP Transport Init' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:10.014 17:53:19 -- rpc/skip_rpc.sh@52 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/log.txt 00:05:10.014 00:05:10.014 real 0m6.876s 00:05:10.014 user 0m6.607s 00:05:10.014 sys 0m0.692s 00:05:10.014 17:53:19 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:10.014 17:53:19 -- common/autotest_common.sh@10 -- # set +x 00:05:10.014 ************************************ 00:05:10.014 END TEST skip_rpc_with_json 00:05:10.014 ************************************ 00:05:10.014 17:53:19 -- rpc/skip_rpc.sh@75 -- # run_test skip_rpc_with_delay test_skip_rpc_with_delay 00:05:10.014 17:53:19 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:10.014 17:53:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:10.014 17:53:19 -- common/autotest_common.sh@10 -- # set +x 00:05:10.273 ************************************ 00:05:10.273 START TEST skip_rpc_with_delay 00:05:10.273 ************************************ 00:05:10.273 17:53:19 -- common/autotest_common.sh@1121 -- # test_skip_rpc_with_delay 00:05:10.273 17:53:19 -- rpc/skip_rpc.sh@57 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:10.273 17:53:19 -- common/autotest_common.sh@648 -- # local es=0 00:05:10.273 17:53:19 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:10.273 17:53:19 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:10.273 17:53:19 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:10.273 17:53:19 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:10.273 17:53:19 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:10.273 17:53:19 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:10.273 17:53:19 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:10.273 17:53:19 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:10.273 17:53:19 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:10.273 17:53:19 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --no-rpc-server -m 0x1 --wait-for-rpc 00:05:10.273 [2024-04-26 17:53:19.308891] app.c: 751:spdk_app_start: *ERROR*: Cannot use '--wait-for-rpc' if no RPC server is going to be started. 00:05:10.273 [2024-04-26 17:53:19.308962] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 0, errno: 2 00:05:10.273 17:53:19 -- common/autotest_common.sh@651 -- # es=1 00:05:10.273 17:53:19 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:10.273 17:53:19 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:05:10.273 17:53:19 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:10.273 00:05:10.273 real 0m0.068s 00:05:10.273 user 0m0.043s 00:05:10.273 sys 0m0.024s 00:05:10.273 17:53:19 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:10.273 17:53:19 -- common/autotest_common.sh@10 -- # set +x 00:05:10.273 ************************************ 00:05:10.273 END TEST skip_rpc_with_delay 00:05:10.273 ************************************ 00:05:10.273 17:53:19 -- rpc/skip_rpc.sh@77 -- # uname 00:05:10.273 17:53:19 -- rpc/skip_rpc.sh@77 -- # '[' Linux '!=' FreeBSD ']' 00:05:10.273 17:53:19 -- rpc/skip_rpc.sh@78 -- # run_test exit_on_failed_rpc_init test_exit_on_failed_rpc_init 00:05:10.273 17:53:19 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:10.273 17:53:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:10.273 17:53:19 -- common/autotest_common.sh@10 -- # set +x 00:05:10.532 ************************************ 00:05:10.532 START TEST exit_on_failed_rpc_init 00:05:10.532 ************************************ 00:05:10.532 17:53:19 -- common/autotest_common.sh@1121 -- # test_exit_on_failed_rpc_init 00:05:10.532 17:53:19 -- rpc/skip_rpc.sh@62 -- # local spdk_pid=826424 00:05:10.532 17:53:19 -- rpc/skip_rpc.sh@63 -- # waitforlisten 826424 00:05:10.532 17:53:19 -- common/autotest_common.sh@827 -- # '[' -z 826424 ']' 00:05:10.532 17:53:19 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.532 17:53:19 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:10.532 17:53:19 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.532 17:53:19 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:10.532 17:53:19 -- common/autotest_common.sh@10 -- # set +x 00:05:10.532 17:53:19 -- rpc/skip_rpc.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:10.532 [2024-04-26 17:53:19.554510] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:10.532 [2024-04-26 17:53:19.554570] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid826424 ] 00:05:10.532 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.532 [2024-04-26 17:53:19.624805] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.532 [2024-04-26 17:53:19.711931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.469 17:53:20 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:11.469 17:53:20 -- common/autotest_common.sh@860 -- # return 0 00:05:11.469 17:53:20 -- rpc/skip_rpc.sh@65 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:11.469 17:53:20 -- rpc/skip_rpc.sh@67 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:11.469 17:53:20 -- common/autotest_common.sh@648 -- # local es=0 00:05:11.469 17:53:20 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:11.469 17:53:20 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:11.469 17:53:20 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:11.469 17:53:20 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:11.469 17:53:20 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:11.469 17:53:20 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:11.469 17:53:20 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:05:11.469 17:53:20 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:11.469 17:53:20 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt ]] 00:05:11.469 17:53:20 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x2 00:05:11.469 [2024-04-26 17:53:20.402140] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:11.469 [2024-04-26 17:53:20.402195] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid826472 ] 00:05:11.469 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.469 [2024-04-26 17:53:20.473718] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.469 [2024-04-26 17:53:20.556617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:11.469 [2024-04-26 17:53:20.556690] rpc.c: 180:_spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:05:11.469 [2024-04-26 17:53:20.556702] rpc.c: 166:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:05:11.469 [2024-04-26 17:53:20.556710] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:11.469 17:53:20 -- common/autotest_common.sh@651 -- # es=234 00:05:11.469 17:53:20 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:05:11.469 17:53:20 -- common/autotest_common.sh@660 -- # es=106 00:05:11.469 17:53:20 -- common/autotest_common.sh@661 -- # case "$es" in 00:05:11.469 17:53:20 -- common/autotest_common.sh@668 -- # es=1 00:05:11.469 17:53:20 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:05:11.469 17:53:20 -- rpc/skip_rpc.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:05:11.469 17:53:20 -- rpc/skip_rpc.sh@70 -- # killprocess 826424 00:05:11.469 17:53:20 -- common/autotest_common.sh@946 -- # '[' -z 826424 ']' 00:05:11.469 17:53:20 -- common/autotest_common.sh@950 -- # kill -0 826424 00:05:11.729 17:53:20 -- common/autotest_common.sh@951 -- # uname 00:05:11.729 17:53:20 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:11.729 17:53:20 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 826424 00:05:11.729 17:53:20 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:11.729 17:53:20 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:11.729 17:53:20 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 826424' 00:05:11.729 killing process with pid 826424 00:05:11.729 17:53:20 -- common/autotest_common.sh@965 -- # kill 826424 00:05:11.729 17:53:20 -- common/autotest_common.sh@970 -- # wait 826424 00:05:11.988 00:05:11.988 real 0m1.595s 00:05:11.988 user 0m1.783s 00:05:11.988 sys 0m0.486s 00:05:11.988 17:53:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:11.988 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:11.988 ************************************ 00:05:11.988 END TEST exit_on_failed_rpc_init 00:05:11.988 ************************************ 00:05:11.988 17:53:21 -- rpc/skip_rpc.sh@81 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc/config.json 00:05:11.988 00:05:11.988 real 0m14.825s 00:05:11.988 user 0m13.876s 00:05:11.988 sys 0m2.009s 00:05:11.988 17:53:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:11.988 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:11.988 ************************************ 00:05:11.988 END TEST skip_rpc 00:05:11.988 ************************************ 00:05:12.247 17:53:21 -- spdk/autotest.sh@167 -- # run_test rpc_client /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:12.247 17:53:21 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:12.247 17:53:21 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:12.247 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.247 ************************************ 00:05:12.247 START TEST rpc_client 00:05:12.247 ************************************ 00:05:12.247 17:53:21 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:12.505 * Looking for test storage... 00:05:12.505 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client 00:05:12.505 17:53:21 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:12.505 OK 00:05:12.505 17:53:21 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:12.505 00:05:12.505 real 0m0.138s 00:05:12.505 user 0m0.058s 00:05:12.506 sys 0m0.089s 00:05:12.506 17:53:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:12.506 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.506 ************************************ 00:05:12.506 END TEST rpc_client 00:05:12.506 ************************************ 00:05:12.506 17:53:21 -- spdk/autotest.sh@168 -- # run_test json_config /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:12.506 17:53:21 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:12.506 17:53:21 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:12.506 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.506 ************************************ 00:05:12.506 START TEST json_config 00:05:12.506 ************************************ 00:05:12.506 17:53:21 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config.sh 00:05:12.764 17:53:21 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:05:12.764 17:53:21 -- nvmf/common.sh@7 -- # uname -s 00:05:12.765 17:53:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:12.765 17:53:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:12.765 17:53:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:12.765 17:53:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:12.765 17:53:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:12.765 17:53:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:12.765 17:53:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:12.765 17:53:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:12.765 17:53:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:12.765 17:53:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:12.765 17:53:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:05:12.765 17:53:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:05:12.765 17:53:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:12.765 17:53:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:12.765 17:53:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:12.765 17:53:21 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:12.765 17:53:21 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:05:12.765 17:53:21 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:12.765 17:53:21 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:12.765 17:53:21 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:12.765 17:53:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.765 17:53:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.765 17:53:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.765 17:53:21 -- paths/export.sh@5 -- # export PATH 00:05:12.765 17:53:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:12.765 17:53:21 -- nvmf/common.sh@47 -- # : 0 00:05:12.765 17:53:21 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:12.765 17:53:21 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:12.765 17:53:21 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:12.765 17:53:21 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:12.765 17:53:21 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:12.765 17:53:21 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:12.765 17:53:21 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:12.765 17:53:21 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:12.765 17:53:21 -- json_config/json_config.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:05:12.765 17:53:21 -- json_config/json_config.sh@11 -- # [[ 0 -eq 1 ]] 00:05:12.765 17:53:21 -- json_config/json_config.sh@15 -- # [[ 0 -ne 1 ]] 00:05:12.765 17:53:21 -- json_config/json_config.sh@15 -- # [[ 0 -eq 1 ]] 00:05:12.765 17:53:21 -- json_config/json_config.sh@26 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:12.765 17:53:21 -- json_config/json_config.sh@31 -- # app_pid=(['target']='' ['initiator']='') 00:05:12.765 17:53:21 -- json_config/json_config.sh@31 -- # declare -A app_pid 00:05:12.765 17:53:21 -- json_config/json_config.sh@32 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:12.765 17:53:21 -- json_config/json_config.sh@32 -- # declare -A app_socket 00:05:12.765 17:53:21 -- json_config/json_config.sh@33 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:12.765 17:53:21 -- json_config/json_config.sh@33 -- # declare -A app_params 00:05:12.765 17:53:21 -- json_config/json_config.sh@34 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json') 00:05:12.765 17:53:21 -- json_config/json_config.sh@34 -- # declare -A configs_path 00:05:12.765 17:53:21 -- json_config/json_config.sh@40 -- # last_event_id=0 00:05:12.765 17:53:21 -- json_config/json_config.sh@355 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:12.765 17:53:21 -- json_config/json_config.sh@356 -- # echo 'INFO: JSON configuration test init' 00:05:12.765 INFO: JSON configuration test init 00:05:12.765 17:53:21 -- json_config/json_config.sh@357 -- # json_config_test_init 00:05:12.765 17:53:21 -- json_config/json_config.sh@262 -- # timing_enter json_config_test_init 00:05:12.765 17:53:21 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:12.765 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.765 17:53:21 -- json_config/json_config.sh@263 -- # timing_enter json_config_setup_target 00:05:12.765 17:53:21 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:12.765 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.765 17:53:21 -- json_config/json_config.sh@265 -- # json_config_test_start_app target --wait-for-rpc 00:05:12.765 17:53:21 -- json_config/common.sh@9 -- # local app=target 00:05:12.765 17:53:21 -- json_config/common.sh@10 -- # shift 00:05:12.765 17:53:21 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:12.765 17:53:21 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:12.765 17:53:21 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:12.765 17:53:21 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:12.765 17:53:21 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:12.765 17:53:21 -- json_config/common.sh@22 -- # app_pid["$app"]=826774 00:05:12.765 17:53:21 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:12.765 Waiting for target to run... 00:05:12.765 17:53:21 -- json_config/common.sh@25 -- # waitforlisten 826774 /var/tmp/spdk_tgt.sock 00:05:12.765 17:53:21 -- common/autotest_common.sh@827 -- # '[' -z 826774 ']' 00:05:12.765 17:53:21 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:12.765 17:53:21 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:12.765 17:53:21 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:12.765 17:53:21 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:12.765 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:12.765 17:53:21 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:12.765 17:53:21 -- common/autotest_common.sh@10 -- # set +x 00:05:12.765 [2024-04-26 17:53:21.834707] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:12.765 [2024-04-26 17:53:21.834765] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid826774 ] 00:05:12.765 EAL: No free 2048 kB hugepages reported on node 1 00:05:13.023 [2024-04-26 17:53:22.140385] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:13.024 [2024-04-26 17:53:22.212210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.592 17:53:22 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:13.592 17:53:22 -- common/autotest_common.sh@860 -- # return 0 00:05:13.592 17:53:22 -- json_config/common.sh@26 -- # echo '' 00:05:13.592 00:05:13.592 17:53:22 -- json_config/json_config.sh@269 -- # create_accel_config 00:05:13.592 17:53:22 -- json_config/json_config.sh@93 -- # timing_enter create_accel_config 00:05:13.592 17:53:22 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:13.592 17:53:22 -- common/autotest_common.sh@10 -- # set +x 00:05:13.592 17:53:22 -- json_config/json_config.sh@95 -- # [[ 0 -eq 1 ]] 00:05:13.592 17:53:22 -- json_config/json_config.sh@101 -- # timing_exit create_accel_config 00:05:13.592 17:53:22 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:13.592 17:53:22 -- common/autotest_common.sh@10 -- # set +x 00:05:13.592 17:53:22 -- json_config/json_config.sh@273 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:13.592 17:53:22 -- json_config/json_config.sh@274 -- # tgt_rpc load_config 00:05:13.592 17:53:22 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:16.876 17:53:25 -- json_config/json_config.sh@276 -- # tgt_check_notification_types 00:05:16.876 17:53:25 -- json_config/json_config.sh@43 -- # timing_enter tgt_check_notification_types 00:05:16.876 17:53:25 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:16.876 17:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:16.876 17:53:25 -- json_config/json_config.sh@45 -- # local ret=0 00:05:16.876 17:53:25 -- json_config/json_config.sh@46 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:16.876 17:53:25 -- json_config/json_config.sh@46 -- # local enabled_types 00:05:16.876 17:53:25 -- json_config/json_config.sh@48 -- # tgt_rpc notify_get_types 00:05:16.876 17:53:25 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:16.876 17:53:25 -- json_config/json_config.sh@48 -- # jq -r '.[]' 00:05:16.876 17:53:25 -- json_config/json_config.sh@48 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:16.876 17:53:25 -- json_config/json_config.sh@48 -- # local get_types 00:05:16.876 17:53:25 -- json_config/json_config.sh@49 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@54 -- # timing_exit tgt_check_notification_types 00:05:16.876 17:53:25 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:16.876 17:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:16.876 17:53:25 -- json_config/json_config.sh@55 -- # return 0 00:05:16.876 17:53:25 -- json_config/json_config.sh@278 -- # [[ 0 -eq 1 ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@282 -- # [[ 0 -eq 1 ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@286 -- # [[ 0 -eq 1 ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@290 -- # [[ 1 -eq 1 ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@291 -- # create_nvmf_subsystem_config 00:05:16.876 17:53:25 -- json_config/json_config.sh@230 -- # timing_enter create_nvmf_subsystem_config 00:05:16.876 17:53:25 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:16.876 17:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:16.876 17:53:25 -- json_config/json_config.sh@232 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:16.876 17:53:25 -- json_config/json_config.sh@233 -- # [[ rdma == \r\d\m\a ]] 00:05:16.876 17:53:25 -- json_config/json_config.sh@234 -- # TEST_TRANSPORT=rdma 00:05:16.876 17:53:25 -- json_config/json_config.sh@234 -- # nvmftestinit 00:05:16.876 17:53:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:05:16.876 17:53:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:05:16.876 17:53:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:05:16.876 17:53:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:05:16.876 17:53:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:05:16.876 17:53:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:05:16.876 17:53:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:05:16.876 17:53:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:05:16.876 17:53:25 -- nvmf/common.sh@403 -- # [[ phy-fallback != virt ]] 00:05:16.876 17:53:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:05:16.876 17:53:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:05:16.876 17:53:25 -- common/autotest_common.sh@10 -- # set +x 00:05:23.439 17:53:32 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:05:23.439 17:53:32 -- nvmf/common.sh@291 -- # pci_devs=() 00:05:23.439 17:53:32 -- nvmf/common.sh@291 -- # local -a pci_devs 00:05:23.439 17:53:32 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:05:23.439 17:53:32 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:05:23.439 17:53:32 -- nvmf/common.sh@293 -- # pci_drivers=() 00:05:23.439 17:53:32 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:05:23.439 17:53:32 -- nvmf/common.sh@295 -- # net_devs=() 00:05:23.439 17:53:32 -- nvmf/common.sh@295 -- # local -ga net_devs 00:05:23.439 17:53:32 -- nvmf/common.sh@296 -- # e810=() 00:05:23.439 17:53:32 -- nvmf/common.sh@296 -- # local -ga e810 00:05:23.439 17:53:32 -- nvmf/common.sh@297 -- # x722=() 00:05:23.439 17:53:32 -- nvmf/common.sh@297 -- # local -ga x722 00:05:23.439 17:53:32 -- nvmf/common.sh@298 -- # mlx=() 00:05:23.439 17:53:32 -- nvmf/common.sh@298 -- # local -ga mlx 00:05:23.439 17:53:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:05:23.439 17:53:32 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:05:23.439 17:53:32 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:05:23.439 17:53:32 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:05:23.439 17:53:32 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:05:23.439 17:53:32 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:05:23.439 17:53:32 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:05:23.439 17:53:32 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:05:23.440 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:05:23.440 17:53:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:05:23.440 17:53:32 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:05:23.440 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:05:23.440 17:53:32 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:05:23.440 17:53:32 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:23.440 17:53:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:23.440 17:53:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:05:23.440 Found net devices under 0000:18:00.0: mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:05:23.440 17:53:32 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:05:23.440 17:53:32 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:05:23.440 17:53:32 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:05:23.440 Found net devices under 0000:18:00.1: mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:05:23.440 17:53:32 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@403 -- # is_hw=yes 00:05:23.440 17:53:32 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@409 -- # rdma_device_init 00:05:23.440 17:53:32 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:05:23.440 17:53:32 -- nvmf/common.sh@58 -- # uname 00:05:23.440 17:53:32 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:05:23.440 17:53:32 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:05:23.440 17:53:32 -- nvmf/common.sh@63 -- # modprobe ib_core 00:05:23.440 17:53:32 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:05:23.440 17:53:32 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:05:23.440 17:53:32 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:05:23.440 17:53:32 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:05:23.440 17:53:32 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:05:23.440 17:53:32 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:05:23.440 17:53:32 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:05:23.440 17:53:32 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:05:23.440 17:53:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:05:23.440 17:53:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:05:23.440 17:53:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:05:23.440 17:53:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:05:23.440 17:53:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@105 -- # continue 2 00:05:23.440 17:53:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@105 -- # continue 2 00:05:23.440 17:53:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:05:23.440 17:53:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:23.440 17:53:32 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:05:23.440 17:53:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:05:23.440 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:05:23.440 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:05:23.440 altname enp24s0f0np0 00:05:23.440 altname ens785f0np0 00:05:23.440 inet 192.168.100.8/24 scope global mlx_0_0 00:05:23.440 valid_lft forever preferred_lft forever 00:05:23.440 17:53:32 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:05:23.440 17:53:32 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:23.440 17:53:32 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:05:23.440 17:53:32 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:05:23.440 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:05:23.440 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:05:23.440 altname enp24s0f1np1 00:05:23.440 altname ens785f1np1 00:05:23.440 inet 192.168.100.9/24 scope global mlx_0_1 00:05:23.440 valid_lft forever preferred_lft forever 00:05:23.440 17:53:32 -- nvmf/common.sh@411 -- # return 0 00:05:23.440 17:53:32 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:05:23.440 17:53:32 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:05:23.440 17:53:32 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:05:23.440 17:53:32 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:05:23.440 17:53:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:05:23.440 17:53:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:05:23.440 17:53:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:05:23.440 17:53:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:05:23.440 17:53:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:05:23.440 17:53:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@105 -- # continue 2 00:05:23.440 17:53:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:05:23.440 17:53:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:05:23.440 17:53:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@105 -- # continue 2 00:05:23.440 17:53:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:05:23.440 17:53:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:23.440 17:53:32 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:05:23.440 17:53:32 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:05:23.440 17:53:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:05:23.440 17:53:32 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:05:23.440 192.168.100.9' 00:05:23.440 17:53:32 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:05:23.440 192.168.100.9' 00:05:23.440 17:53:32 -- nvmf/common.sh@446 -- # head -n 1 00:05:23.440 17:53:32 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:05:23.440 17:53:32 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:05:23.440 192.168.100.9' 00:05:23.440 17:53:32 -- nvmf/common.sh@447 -- # tail -n +2 00:05:23.440 17:53:32 -- nvmf/common.sh@447 -- # head -n 1 00:05:23.440 17:53:32 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:05:23.440 17:53:32 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:05:23.440 17:53:32 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:05:23.440 17:53:32 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:05:23.440 17:53:32 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:05:23.440 17:53:32 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:05:23.440 17:53:32 -- json_config/json_config.sh@237 -- # [[ -z 192.168.100.8 ]] 00:05:23.440 17:53:32 -- json_config/json_config.sh@242 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:23.440 17:53:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:23.440 MallocForNvmf0 00:05:23.699 17:53:32 -- json_config/json_config.sh@243 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:23.699 17:53:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:23.699 MallocForNvmf1 00:05:23.699 17:53:32 -- json_config/json_config.sh@245 -- # tgt_rpc nvmf_create_transport -t rdma -u 8192 -c 0 00:05:23.699 17:53:32 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t rdma -u 8192 -c 0 00:05:23.957 [2024-04-26 17:53:32.962716] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:05:23.957 [2024-04-26 17:53:32.989004] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x13334c0/0x1460380) succeed. 00:05:23.957 [2024-04-26 17:53:33.001028] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x13356b0/0x1340240) succeed. 00:05:23.957 17:53:33 -- json_config/json_config.sh@246 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:23.957 17:53:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:24.216 17:53:33 -- json_config/json_config.sh@247 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:24.216 17:53:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:24.216 17:53:33 -- json_config/json_config.sh@248 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:24.216 17:53:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:24.474 17:53:33 -- json_config/json_config.sh@249 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:05:24.474 17:53:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:05:24.732 [2024-04-26 17:53:33.722054] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:05:24.732 17:53:33 -- json_config/json_config.sh@251 -- # timing_exit create_nvmf_subsystem_config 00:05:24.732 17:53:33 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:24.732 17:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:24.732 17:53:33 -- json_config/json_config.sh@293 -- # timing_exit json_config_setup_target 00:05:24.732 17:53:33 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:24.732 17:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:24.732 17:53:33 -- json_config/json_config.sh@295 -- # [[ 0 -eq 1 ]] 00:05:24.732 17:53:33 -- json_config/json_config.sh@300 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:24.732 17:53:33 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:24.991 MallocBdevForConfigChangeCheck 00:05:24.991 17:53:34 -- json_config/json_config.sh@302 -- # timing_exit json_config_test_init 00:05:24.991 17:53:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:24.991 17:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:24.991 17:53:34 -- json_config/json_config.sh@359 -- # tgt_rpc save_config 00:05:24.991 17:53:34 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:25.249 17:53:34 -- json_config/json_config.sh@361 -- # echo 'INFO: shutting down applications...' 00:05:25.249 INFO: shutting down applications... 00:05:25.249 17:53:34 -- json_config/json_config.sh@362 -- # [[ 0 -eq 1 ]] 00:05:25.249 17:53:34 -- json_config/json_config.sh@368 -- # json_config_clear target 00:05:25.249 17:53:34 -- json_config/json_config.sh@332 -- # [[ -n 22 ]] 00:05:25.249 17:53:34 -- json_config/json_config.sh@333 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:29.441 Calling clear_iscsi_subsystem 00:05:29.441 Calling clear_nvmf_subsystem 00:05:29.441 Calling clear_nbd_subsystem 00:05:29.441 Calling clear_ublk_subsystem 00:05:29.441 Calling clear_vhost_blk_subsystem 00:05:29.441 Calling clear_vhost_scsi_subsystem 00:05:29.441 Calling clear_bdev_subsystem 00:05:29.441 17:53:38 -- json_config/json_config.sh@337 -- # local config_filter=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py 00:05:29.441 17:53:38 -- json_config/json_config.sh@343 -- # count=100 00:05:29.441 17:53:38 -- json_config/json_config.sh@344 -- # '[' 100 -gt 0 ']' 00:05:29.441 17:53:38 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:29.441 17:53:38 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:29.441 17:53:38 -- json_config/json_config.sh@345 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:29.441 17:53:38 -- json_config/json_config.sh@345 -- # break 00:05:29.441 17:53:38 -- json_config/json_config.sh@350 -- # '[' 100 -eq 0 ']' 00:05:29.441 17:53:38 -- json_config/json_config.sh@369 -- # json_config_test_shutdown_app target 00:05:29.441 17:53:38 -- json_config/common.sh@31 -- # local app=target 00:05:29.441 17:53:38 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:05:29.441 17:53:38 -- json_config/common.sh@35 -- # [[ -n 826774 ]] 00:05:29.441 17:53:38 -- json_config/common.sh@38 -- # kill -SIGINT 826774 00:05:29.441 17:53:38 -- json_config/common.sh@40 -- # (( i = 0 )) 00:05:29.441 17:53:38 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:29.441 17:53:38 -- json_config/common.sh@41 -- # kill -0 826774 00:05:29.441 17:53:38 -- json_config/common.sh@45 -- # sleep 0.5 00:05:29.700 [2024-04-26 17:53:38.687398] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:05:29.960 17:53:39 -- json_config/common.sh@40 -- # (( i++ )) 00:05:29.960 17:53:39 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:29.960 17:53:39 -- json_config/common.sh@41 -- # kill -0 826774 00:05:29.960 17:53:39 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:05:29.960 17:53:39 -- json_config/common.sh@43 -- # break 00:05:29.960 17:53:39 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:05:29.960 17:53:39 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:05:29.960 SPDK target shutdown done 00:05:29.960 17:53:39 -- json_config/json_config.sh@371 -- # echo 'INFO: relaunching applications...' 00:05:29.960 INFO: relaunching applications... 00:05:29.960 17:53:39 -- json_config/json_config.sh@372 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:29.960 17:53:39 -- json_config/common.sh@9 -- # local app=target 00:05:29.960 17:53:39 -- json_config/common.sh@10 -- # shift 00:05:29.960 17:53:39 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:29.960 17:53:39 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:29.960 17:53:39 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:29.960 17:53:39 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:29.960 17:53:39 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:29.960 17:53:39 -- json_config/common.sh@22 -- # app_pid["$app"]=831193 00:05:29.960 17:53:39 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:29.960 Waiting for target to run... 00:05:29.960 17:53:39 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:29.960 17:53:39 -- json_config/common.sh@25 -- # waitforlisten 831193 /var/tmp/spdk_tgt.sock 00:05:29.960 17:53:39 -- common/autotest_common.sh@827 -- # '[' -z 831193 ']' 00:05:29.960 17:53:39 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:29.960 17:53:39 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:29.960 17:53:39 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:29.960 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:29.960 17:53:39 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:29.960 17:53:39 -- common/autotest_common.sh@10 -- # set +x 00:05:29.960 [2024-04-26 17:53:39.136023] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:29.960 [2024-04-26 17:53:39.136088] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid831193 ] 00:05:30.220 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.479 [2024-04-26 17:53:39.465622] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.479 [2024-04-26 17:53:39.539566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.768 [2024-04-26 17:53:42.572807] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb39490/0xabf6c0) succeed. 00:05:33.768 [2024-04-26 17:53:42.585191] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb38480/0x99f580) succeed. 00:05:33.768 [2024-04-26 17:53:42.636908] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:05:34.335 17:53:43 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:34.335 17:53:43 -- common/autotest_common.sh@860 -- # return 0 00:05:34.335 17:53:43 -- json_config/common.sh@26 -- # echo '' 00:05:34.335 00:05:34.335 17:53:43 -- json_config/json_config.sh@373 -- # [[ 0 -eq 1 ]] 00:05:34.335 17:53:43 -- json_config/json_config.sh@377 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:34.335 INFO: Checking if target configuration is the same... 00:05:34.335 17:53:43 -- json_config/json_config.sh@378 -- # tgt_rpc save_config 00:05:34.335 17:53:43 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:34.335 17:53:43 -- json_config/json_config.sh@378 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.335 + '[' 2 -ne 2 ']' 00:05:34.335 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:34.335 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:05:34.335 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:05:34.335 +++ basename /dev/fd/62 00:05:34.335 ++ mktemp /tmp/62.XXX 00:05:34.335 + tmp_file_1=/tmp/62.3yo 00:05:34.335 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.335 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:34.335 + tmp_file_2=/tmp/spdk_tgt_config.json.O2d 00:05:34.335 + ret=0 00:05:34.335 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:34.593 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:34.593 + diff -u /tmp/62.3yo /tmp/spdk_tgt_config.json.O2d 00:05:34.593 + echo 'INFO: JSON config files are the same' 00:05:34.593 INFO: JSON config files are the same 00:05:34.593 + rm /tmp/62.3yo /tmp/spdk_tgt_config.json.O2d 00:05:34.593 + exit 0 00:05:34.593 17:53:43 -- json_config/json_config.sh@379 -- # [[ 0 -eq 1 ]] 00:05:34.593 17:53:43 -- json_config/json_config.sh@384 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:34.593 INFO: changing configuration and checking if this can be detected... 00:05:34.593 17:53:43 -- json_config/json_config.sh@386 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:34.593 17:53:43 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:34.875 17:53:43 -- json_config/json_config.sh@387 -- # tgt_rpc save_config 00:05:34.875 17:53:43 -- json_config/common.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:34.875 17:53:43 -- json_config/json_config.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.875 + '[' 2 -ne 2 ']' 00:05:34.875 +++ dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:34.875 ++ readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/../.. 00:05:34.875 + rootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:05:34.875 +++ basename /dev/fd/62 00:05:34.875 ++ mktemp /tmp/62.XXX 00:05:34.875 + tmp_file_1=/tmp/62.3sw 00:05:34.875 +++ basename /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:34.875 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:34.875 + tmp_file_2=/tmp/spdk_tgt_config.json.pkU 00:05:34.875 + ret=0 00:05:34.875 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.133 + /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:35.133 + diff -u /tmp/62.3sw /tmp/spdk_tgt_config.json.pkU 00:05:35.133 + ret=1 00:05:35.133 + echo '=== Start of file: /tmp/62.3sw ===' 00:05:35.133 + cat /tmp/62.3sw 00:05:35.133 + echo '=== End of file: /tmp/62.3sw ===' 00:05:35.133 + echo '' 00:05:35.133 + echo '=== Start of file: /tmp/spdk_tgt_config.json.pkU ===' 00:05:35.134 + cat /tmp/spdk_tgt_config.json.pkU 00:05:35.134 + echo '=== End of file: /tmp/spdk_tgt_config.json.pkU ===' 00:05:35.134 + echo '' 00:05:35.134 + rm /tmp/62.3sw /tmp/spdk_tgt_config.json.pkU 00:05:35.134 + exit 1 00:05:35.134 17:53:44 -- json_config/json_config.sh@391 -- # echo 'INFO: configuration change detected.' 00:05:35.134 INFO: configuration change detected. 00:05:35.134 17:53:44 -- json_config/json_config.sh@394 -- # json_config_test_fini 00:05:35.134 17:53:44 -- json_config/json_config.sh@306 -- # timing_enter json_config_test_fini 00:05:35.134 17:53:44 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:35.134 17:53:44 -- common/autotest_common.sh@10 -- # set +x 00:05:35.134 17:53:44 -- json_config/json_config.sh@307 -- # local ret=0 00:05:35.134 17:53:44 -- json_config/json_config.sh@309 -- # [[ -n '' ]] 00:05:35.134 17:53:44 -- json_config/json_config.sh@317 -- # [[ -n 831193 ]] 00:05:35.134 17:53:44 -- json_config/json_config.sh@320 -- # cleanup_bdev_subsystem_config 00:05:35.134 17:53:44 -- json_config/json_config.sh@184 -- # timing_enter cleanup_bdev_subsystem_config 00:05:35.134 17:53:44 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:35.134 17:53:44 -- common/autotest_common.sh@10 -- # set +x 00:05:35.134 17:53:44 -- json_config/json_config.sh@186 -- # [[ 0 -eq 1 ]] 00:05:35.134 17:53:44 -- json_config/json_config.sh@193 -- # uname -s 00:05:35.134 17:53:44 -- json_config/json_config.sh@193 -- # [[ Linux = Linux ]] 00:05:35.134 17:53:44 -- json_config/json_config.sh@194 -- # rm -f /sample_aio 00:05:35.134 17:53:44 -- json_config/json_config.sh@197 -- # [[ 0 -eq 1 ]] 00:05:35.134 17:53:44 -- json_config/json_config.sh@201 -- # timing_exit cleanup_bdev_subsystem_config 00:05:35.134 17:53:44 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:35.134 17:53:44 -- common/autotest_common.sh@10 -- # set +x 00:05:35.134 17:53:44 -- json_config/json_config.sh@323 -- # killprocess 831193 00:05:35.134 17:53:44 -- common/autotest_common.sh@946 -- # '[' -z 831193 ']' 00:05:35.134 17:53:44 -- common/autotest_common.sh@950 -- # kill -0 831193 00:05:35.134 17:53:44 -- common/autotest_common.sh@951 -- # uname 00:05:35.134 17:53:44 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:35.134 17:53:44 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 831193 00:05:35.392 17:53:44 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:35.392 17:53:44 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:35.392 17:53:44 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 831193' 00:05:35.392 killing process with pid 831193 00:05:35.392 17:53:44 -- common/autotest_common.sh@965 -- # kill 831193 00:05:35.392 17:53:44 -- common/autotest_common.sh@970 -- # wait 831193 00:05:35.392 [2024-04-26 17:53:44.470510] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:05:39.580 17:53:48 -- json_config/json_config.sh@326 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-phy-autotest/spdk/spdk_tgt_config.json 00:05:39.581 17:53:48 -- json_config/json_config.sh@327 -- # timing_exit json_config_test_fini 00:05:39.581 17:53:48 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:39.581 17:53:48 -- common/autotest_common.sh@10 -- # set +x 00:05:39.581 17:53:48 -- json_config/json_config.sh@328 -- # return 0 00:05:39.581 17:53:48 -- json_config/json_config.sh@396 -- # echo 'INFO: Success' 00:05:39.581 INFO: Success 00:05:39.581 17:53:48 -- json_config/json_config.sh@1 -- # nvmftestfini 00:05:39.581 17:53:48 -- nvmf/common.sh@477 -- # nvmfcleanup 00:05:39.581 17:53:48 -- nvmf/common.sh@117 -- # sync 00:05:39.581 17:53:48 -- nvmf/common.sh@119 -- # '[' '' == tcp ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@119 -- # '[' '' == rdma ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@484 -- # [[ '' == \t\c\p ]] 00:05:39.581 00:05:39.581 real 0m26.696s 00:05:39.581 user 0m29.223s 00:05:39.581 sys 0m7.084s 00:05:39.581 17:53:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:39.581 17:53:48 -- common/autotest_common.sh@10 -- # set +x 00:05:39.581 ************************************ 00:05:39.581 END TEST json_config 00:05:39.581 ************************************ 00:05:39.581 17:53:48 -- spdk/autotest.sh@169 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:39.581 17:53:48 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:39.581 17:53:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:39.581 17:53:48 -- common/autotest_common.sh@10 -- # set +x 00:05:39.581 ************************************ 00:05:39.581 START TEST json_config_extra_key 00:05:39.581 ************************************ 00:05:39.581 17:53:48 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:05:39.581 17:53:48 -- nvmf/common.sh@7 -- # uname -s 00:05:39.581 17:53:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:39.581 17:53:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:39.581 17:53:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:39.581 17:53:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:39.581 17:53:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:39.581 17:53:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:39.581 17:53:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:39.581 17:53:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:39.581 17:53:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:39.581 17:53:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:39.581 17:53:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:05:39.581 17:53:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:05:39.581 17:53:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:39.581 17:53:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:39.581 17:53:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:39.581 17:53:48 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:05:39.581 17:53:48 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:05:39.581 17:53:48 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:39.581 17:53:48 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:39.581 17:53:48 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:39.581 17:53:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:39.581 17:53:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:39.581 17:53:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:39.581 17:53:48 -- paths/export.sh@5 -- # export PATH 00:05:39.581 17:53:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:39.581 17:53:48 -- nvmf/common.sh@47 -- # : 0 00:05:39.581 17:53:48 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:05:39.581 17:53:48 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:05:39.581 17:53:48 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:39.581 17:53:48 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:39.581 17:53:48 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:05:39.581 17:53:48 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/common.sh 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@17 -- # app_pid=(['target']='') 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_pid 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@18 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_socket 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@19 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@19 -- # declare -A app_params 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@20 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@20 -- # declare -A configs_path 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@22 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@24 -- # echo 'INFO: launching applications...' 00:05:39.581 INFO: launching applications... 00:05:39.581 17:53:48 -- json_config/json_config_extra_key.sh@25 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:05:39.581 17:53:48 -- json_config/common.sh@9 -- # local app=target 00:05:39.581 17:53:48 -- json_config/common.sh@10 -- # shift 00:05:39.581 17:53:48 -- json_config/common.sh@12 -- # [[ -n 22 ]] 00:05:39.581 17:53:48 -- json_config/common.sh@13 -- # [[ -z '' ]] 00:05:39.581 17:53:48 -- json_config/common.sh@15 -- # local app_extra_params= 00:05:39.581 17:53:48 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:39.581 17:53:48 -- json_config/common.sh@16 -- # [[ 0 -eq 1 ]] 00:05:39.581 17:53:48 -- json_config/common.sh@22 -- # app_pid["$app"]=832592 00:05:39.581 17:53:48 -- json_config/common.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/extra_key.json 00:05:39.581 17:53:48 -- json_config/common.sh@24 -- # echo 'Waiting for target to run...' 00:05:39.581 Waiting for target to run... 00:05:39.581 17:53:48 -- json_config/common.sh@25 -- # waitforlisten 832592 /var/tmp/spdk_tgt.sock 00:05:39.581 17:53:48 -- common/autotest_common.sh@827 -- # '[' -z 832592 ']' 00:05:39.581 17:53:48 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:39.581 17:53:48 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:39.581 17:53:48 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:39.581 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:39.581 17:53:48 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:39.581 17:53:48 -- common/autotest_common.sh@10 -- # set +x 00:05:39.581 [2024-04-26 17:53:48.682968] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:39.581 [2024-04-26 17:53:48.683028] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid832592 ] 00:05:39.581 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.839 [2024-04-26 17:53:48.997046] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.097 [2024-04-26 17:53:49.068230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.355 17:53:49 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:40.356 17:53:49 -- common/autotest_common.sh@860 -- # return 0 00:05:40.356 17:53:49 -- json_config/common.sh@26 -- # echo '' 00:05:40.356 00:05:40.356 17:53:49 -- json_config/json_config_extra_key.sh@27 -- # echo 'INFO: shutting down applications...' 00:05:40.356 INFO: shutting down applications... 00:05:40.356 17:53:49 -- json_config/json_config_extra_key.sh@28 -- # json_config_test_shutdown_app target 00:05:40.356 17:53:49 -- json_config/common.sh@31 -- # local app=target 00:05:40.356 17:53:49 -- json_config/common.sh@34 -- # [[ -n 22 ]] 00:05:40.356 17:53:49 -- json_config/common.sh@35 -- # [[ -n 832592 ]] 00:05:40.356 17:53:49 -- json_config/common.sh@38 -- # kill -SIGINT 832592 00:05:40.356 17:53:49 -- json_config/common.sh@40 -- # (( i = 0 )) 00:05:40.356 17:53:49 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:40.356 17:53:49 -- json_config/common.sh@41 -- # kill -0 832592 00:05:40.356 17:53:49 -- json_config/common.sh@45 -- # sleep 0.5 00:05:40.923 17:53:50 -- json_config/common.sh@40 -- # (( i++ )) 00:05:40.923 17:53:50 -- json_config/common.sh@40 -- # (( i < 30 )) 00:05:40.923 17:53:50 -- json_config/common.sh@41 -- # kill -0 832592 00:05:40.923 17:53:50 -- json_config/common.sh@42 -- # app_pid["$app"]= 00:05:40.923 17:53:50 -- json_config/common.sh@43 -- # break 00:05:40.923 17:53:50 -- json_config/common.sh@48 -- # [[ -n '' ]] 00:05:40.923 17:53:50 -- json_config/common.sh@53 -- # echo 'SPDK target shutdown done' 00:05:40.923 SPDK target shutdown done 00:05:40.923 17:53:50 -- json_config/json_config_extra_key.sh@30 -- # echo Success 00:05:40.923 Success 00:05:40.923 00:05:40.923 real 0m1.474s 00:05:40.923 user 0m1.275s 00:05:40.923 sys 0m0.430s 00:05:40.923 17:53:50 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:40.923 17:53:50 -- common/autotest_common.sh@10 -- # set +x 00:05:40.923 ************************************ 00:05:40.923 END TEST json_config_extra_key 00:05:40.923 ************************************ 00:05:40.923 17:53:50 -- spdk/autotest.sh@170 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:40.923 17:53:50 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:40.923 17:53:50 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:40.923 17:53:50 -- common/autotest_common.sh@10 -- # set +x 00:05:41.182 ************************************ 00:05:41.182 START TEST alias_rpc 00:05:41.182 ************************************ 00:05:41.182 17:53:50 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:41.182 * Looking for test storage... 00:05:41.182 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/alias_rpc 00:05:41.182 17:53:50 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:41.182 17:53:50 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=832838 00:05:41.182 17:53:50 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 832838 00:05:41.182 17:53:50 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:41.182 17:53:50 -- common/autotest_common.sh@827 -- # '[' -z 832838 ']' 00:05:41.182 17:53:50 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:41.182 17:53:50 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:41.182 17:53:50 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:41.182 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:41.182 17:53:50 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:41.182 17:53:50 -- common/autotest_common.sh@10 -- # set +x 00:05:41.182 [2024-04-26 17:53:50.367495] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:41.182 [2024-04-26 17:53:50.367562] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid832838 ] 00:05:41.442 EAL: No free 2048 kB hugepages reported on node 1 00:05:41.442 [2024-04-26 17:53:50.441522] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.442 [2024-04-26 17:53:50.530048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.009 17:53:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:42.009 17:53:51 -- common/autotest_common.sh@860 -- # return 0 00:05:42.009 17:53:51 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:42.268 17:53:51 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 832838 00:05:42.269 17:53:51 -- common/autotest_common.sh@946 -- # '[' -z 832838 ']' 00:05:42.269 17:53:51 -- common/autotest_common.sh@950 -- # kill -0 832838 00:05:42.269 17:53:51 -- common/autotest_common.sh@951 -- # uname 00:05:42.269 17:53:51 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:42.269 17:53:51 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 832838 00:05:42.269 17:53:51 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:42.269 17:53:51 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:42.269 17:53:51 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 832838' 00:05:42.269 killing process with pid 832838 00:05:42.269 17:53:51 -- common/autotest_common.sh@965 -- # kill 832838 00:05:42.269 17:53:51 -- common/autotest_common.sh@970 -- # wait 832838 00:05:42.838 00:05:42.838 real 0m1.576s 00:05:42.838 user 0m1.625s 00:05:42.838 sys 0m0.487s 00:05:42.838 17:53:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:42.838 17:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:42.838 ************************************ 00:05:42.838 END TEST alias_rpc 00:05:42.838 ************************************ 00:05:42.838 17:53:51 -- spdk/autotest.sh@172 -- # [[ 0 -eq 0 ]] 00:05:42.838 17:53:51 -- spdk/autotest.sh@173 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:42.838 17:53:51 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:42.838 17:53:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:42.838 17:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:42.838 ************************************ 00:05:42.838 START TEST spdkcli_tcp 00:05:42.838 ************************************ 00:05:42.838 17:53:51 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:43.097 * Looking for test storage... 00:05:43.097 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:05:43.097 17:53:52 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:43.097 17:53:52 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:43.097 17:53:52 -- common/autotest_common.sh@720 -- # xtrace_disable 00:05:43.097 17:53:52 -- common/autotest_common.sh@10 -- # set +x 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=833190 00:05:43.097 17:53:52 -- spdkcli/tcp.sh@27 -- # waitforlisten 833190 00:05:43.097 17:53:52 -- common/autotest_common.sh@827 -- # '[' -z 833190 ']' 00:05:43.097 17:53:52 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:43.097 17:53:52 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:43.097 17:53:52 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:43.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:43.097 17:53:52 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:43.097 17:53:52 -- common/autotest_common.sh@10 -- # set +x 00:05:43.097 [2024-04-26 17:53:52.131179] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:43.097 [2024-04-26 17:53:52.131244] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833190 ] 00:05:43.097 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.097 [2024-04-26 17:53:52.202544] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:43.355 [2024-04-26 17:53:52.292887] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:43.355 [2024-04-26 17:53:52.292890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.921 17:53:52 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:43.921 17:53:52 -- common/autotest_common.sh@860 -- # return 0 00:05:43.921 17:53:52 -- spdkcli/tcp.sh@31 -- # socat_pid=833270 00:05:43.921 17:53:52 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:43.921 17:53:52 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:43.921 [ 00:05:43.921 "bdev_malloc_delete", 00:05:43.921 "bdev_malloc_create", 00:05:43.921 "bdev_null_resize", 00:05:43.921 "bdev_null_delete", 00:05:43.921 "bdev_null_create", 00:05:43.921 "bdev_nvme_cuse_unregister", 00:05:43.921 "bdev_nvme_cuse_register", 00:05:43.921 "bdev_opal_new_user", 00:05:43.921 "bdev_opal_set_lock_state", 00:05:43.921 "bdev_opal_delete", 00:05:43.921 "bdev_opal_get_info", 00:05:43.921 "bdev_opal_create", 00:05:43.921 "bdev_nvme_opal_revert", 00:05:43.921 "bdev_nvme_opal_init", 00:05:43.921 "bdev_nvme_send_cmd", 00:05:43.921 "bdev_nvme_get_path_iostat", 00:05:43.921 "bdev_nvme_get_mdns_discovery_info", 00:05:43.921 "bdev_nvme_stop_mdns_discovery", 00:05:43.921 "bdev_nvme_start_mdns_discovery", 00:05:43.921 "bdev_nvme_set_multipath_policy", 00:05:43.921 "bdev_nvme_set_preferred_path", 00:05:43.921 "bdev_nvme_get_io_paths", 00:05:43.921 "bdev_nvme_remove_error_injection", 00:05:43.921 "bdev_nvme_add_error_injection", 00:05:43.921 "bdev_nvme_get_discovery_info", 00:05:43.921 "bdev_nvme_stop_discovery", 00:05:43.921 "bdev_nvme_start_discovery", 00:05:43.921 "bdev_nvme_get_controller_health_info", 00:05:43.921 "bdev_nvme_disable_controller", 00:05:43.921 "bdev_nvme_enable_controller", 00:05:43.921 "bdev_nvme_reset_controller", 00:05:43.921 "bdev_nvme_get_transport_statistics", 00:05:43.921 "bdev_nvme_apply_firmware", 00:05:43.921 "bdev_nvme_detach_controller", 00:05:43.921 "bdev_nvme_get_controllers", 00:05:43.921 "bdev_nvme_attach_controller", 00:05:43.921 "bdev_nvme_set_hotplug", 00:05:43.921 "bdev_nvme_set_options", 00:05:43.921 "bdev_passthru_delete", 00:05:43.921 "bdev_passthru_create", 00:05:43.921 "bdev_lvol_grow_lvstore", 00:05:43.921 "bdev_lvol_get_lvols", 00:05:43.921 "bdev_lvol_get_lvstores", 00:05:43.921 "bdev_lvol_delete", 00:05:43.921 "bdev_lvol_set_read_only", 00:05:43.921 "bdev_lvol_resize", 00:05:43.921 "bdev_lvol_decouple_parent", 00:05:43.921 "bdev_lvol_inflate", 00:05:43.921 "bdev_lvol_rename", 00:05:43.921 "bdev_lvol_clone_bdev", 00:05:43.921 "bdev_lvol_clone", 00:05:43.921 "bdev_lvol_snapshot", 00:05:43.921 "bdev_lvol_create", 00:05:43.921 "bdev_lvol_delete_lvstore", 00:05:43.921 "bdev_lvol_rename_lvstore", 00:05:43.921 "bdev_lvol_create_lvstore", 00:05:43.922 "bdev_raid_set_options", 00:05:43.922 "bdev_raid_remove_base_bdev", 00:05:43.922 "bdev_raid_add_base_bdev", 00:05:43.922 "bdev_raid_delete", 00:05:43.922 "bdev_raid_create", 00:05:43.922 "bdev_raid_get_bdevs", 00:05:43.922 "bdev_error_inject_error", 00:05:43.922 "bdev_error_delete", 00:05:43.922 "bdev_error_create", 00:05:43.922 "bdev_split_delete", 00:05:43.922 "bdev_split_create", 00:05:43.922 "bdev_delay_delete", 00:05:43.922 "bdev_delay_create", 00:05:43.922 "bdev_delay_update_latency", 00:05:43.922 "bdev_zone_block_delete", 00:05:43.922 "bdev_zone_block_create", 00:05:43.922 "blobfs_create", 00:05:43.922 "blobfs_detect", 00:05:43.922 "blobfs_set_cache_size", 00:05:43.922 "bdev_aio_delete", 00:05:43.922 "bdev_aio_rescan", 00:05:43.922 "bdev_aio_create", 00:05:43.922 "bdev_ftl_set_property", 00:05:43.922 "bdev_ftl_get_properties", 00:05:43.922 "bdev_ftl_get_stats", 00:05:43.922 "bdev_ftl_unmap", 00:05:43.922 "bdev_ftl_unload", 00:05:43.922 "bdev_ftl_delete", 00:05:43.922 "bdev_ftl_load", 00:05:43.922 "bdev_ftl_create", 00:05:43.922 "bdev_virtio_attach_controller", 00:05:43.922 "bdev_virtio_scsi_get_devices", 00:05:43.922 "bdev_virtio_detach_controller", 00:05:43.922 "bdev_virtio_blk_set_hotplug", 00:05:43.922 "bdev_iscsi_delete", 00:05:43.922 "bdev_iscsi_create", 00:05:43.922 "bdev_iscsi_set_options", 00:05:43.922 "accel_error_inject_error", 00:05:43.922 "ioat_scan_accel_module", 00:05:43.922 "dsa_scan_accel_module", 00:05:43.922 "iaa_scan_accel_module", 00:05:43.922 "keyring_file_remove_key", 00:05:43.922 "keyring_file_add_key", 00:05:43.922 "iscsi_get_histogram", 00:05:43.922 "iscsi_enable_histogram", 00:05:43.922 "iscsi_set_options", 00:05:43.922 "iscsi_get_auth_groups", 00:05:43.922 "iscsi_auth_group_remove_secret", 00:05:43.922 "iscsi_auth_group_add_secret", 00:05:43.922 "iscsi_delete_auth_group", 00:05:43.922 "iscsi_create_auth_group", 00:05:43.922 "iscsi_set_discovery_auth", 00:05:43.922 "iscsi_get_options", 00:05:43.922 "iscsi_target_node_request_logout", 00:05:43.922 "iscsi_target_node_set_redirect", 00:05:43.922 "iscsi_target_node_set_auth", 00:05:43.922 "iscsi_target_node_add_lun", 00:05:43.922 "iscsi_get_stats", 00:05:43.922 "iscsi_get_connections", 00:05:43.922 "iscsi_portal_group_set_auth", 00:05:43.922 "iscsi_start_portal_group", 00:05:43.922 "iscsi_delete_portal_group", 00:05:43.922 "iscsi_create_portal_group", 00:05:43.922 "iscsi_get_portal_groups", 00:05:43.922 "iscsi_delete_target_node", 00:05:43.922 "iscsi_target_node_remove_pg_ig_maps", 00:05:43.922 "iscsi_target_node_add_pg_ig_maps", 00:05:43.922 "iscsi_create_target_node", 00:05:43.922 "iscsi_get_target_nodes", 00:05:43.922 "iscsi_delete_initiator_group", 00:05:43.922 "iscsi_initiator_group_remove_initiators", 00:05:43.922 "iscsi_initiator_group_add_initiators", 00:05:43.922 "iscsi_create_initiator_group", 00:05:43.922 "iscsi_get_initiator_groups", 00:05:43.922 "nvmf_set_crdt", 00:05:43.922 "nvmf_set_config", 00:05:43.922 "nvmf_set_max_subsystems", 00:05:43.922 "nvmf_subsystem_get_listeners", 00:05:43.922 "nvmf_subsystem_get_qpairs", 00:05:43.922 "nvmf_subsystem_get_controllers", 00:05:43.922 "nvmf_get_stats", 00:05:43.922 "nvmf_get_transports", 00:05:43.922 "nvmf_create_transport", 00:05:43.922 "nvmf_get_targets", 00:05:43.922 "nvmf_delete_target", 00:05:43.922 "nvmf_create_target", 00:05:43.922 "nvmf_subsystem_allow_any_host", 00:05:43.922 "nvmf_subsystem_remove_host", 00:05:43.922 "nvmf_subsystem_add_host", 00:05:43.922 "nvmf_ns_remove_host", 00:05:43.922 "nvmf_ns_add_host", 00:05:43.922 "nvmf_subsystem_remove_ns", 00:05:43.922 "nvmf_subsystem_add_ns", 00:05:43.922 "nvmf_subsystem_listener_set_ana_state", 00:05:43.922 "nvmf_discovery_get_referrals", 00:05:43.922 "nvmf_discovery_remove_referral", 00:05:43.922 "nvmf_discovery_add_referral", 00:05:43.922 "nvmf_subsystem_remove_listener", 00:05:43.922 "nvmf_subsystem_add_listener", 00:05:43.922 "nvmf_delete_subsystem", 00:05:43.922 "nvmf_create_subsystem", 00:05:43.922 "nvmf_get_subsystems", 00:05:43.922 "env_dpdk_get_mem_stats", 00:05:43.922 "nbd_get_disks", 00:05:43.922 "nbd_stop_disk", 00:05:43.922 "nbd_start_disk", 00:05:43.922 "ublk_recover_disk", 00:05:43.922 "ublk_get_disks", 00:05:43.922 "ublk_stop_disk", 00:05:43.922 "ublk_start_disk", 00:05:43.922 "ublk_destroy_target", 00:05:43.922 "ublk_create_target", 00:05:43.922 "virtio_blk_create_transport", 00:05:43.922 "virtio_blk_get_transports", 00:05:43.922 "vhost_controller_set_coalescing", 00:05:43.922 "vhost_get_controllers", 00:05:43.922 "vhost_delete_controller", 00:05:43.922 "vhost_create_blk_controller", 00:05:43.922 "vhost_scsi_controller_remove_target", 00:05:43.922 "vhost_scsi_controller_add_target", 00:05:43.922 "vhost_start_scsi_controller", 00:05:43.922 "vhost_create_scsi_controller", 00:05:43.922 "thread_set_cpumask", 00:05:43.922 "framework_get_scheduler", 00:05:43.922 "framework_set_scheduler", 00:05:43.922 "framework_get_reactors", 00:05:43.922 "thread_get_io_channels", 00:05:43.922 "thread_get_pollers", 00:05:43.922 "thread_get_stats", 00:05:43.922 "framework_monitor_context_switch", 00:05:43.922 "spdk_kill_instance", 00:05:43.922 "log_enable_timestamps", 00:05:43.922 "log_get_flags", 00:05:43.922 "log_clear_flag", 00:05:43.922 "log_set_flag", 00:05:43.922 "log_get_level", 00:05:43.922 "log_set_level", 00:05:43.922 "log_get_print_level", 00:05:43.922 "log_set_print_level", 00:05:43.922 "framework_enable_cpumask_locks", 00:05:43.922 "framework_disable_cpumask_locks", 00:05:43.922 "framework_wait_init", 00:05:43.922 "framework_start_init", 00:05:43.922 "scsi_get_devices", 00:05:43.922 "bdev_get_histogram", 00:05:43.922 "bdev_enable_histogram", 00:05:43.922 "bdev_set_qos_limit", 00:05:43.922 "bdev_set_qd_sampling_period", 00:05:43.922 "bdev_get_bdevs", 00:05:43.922 "bdev_reset_iostat", 00:05:43.922 "bdev_get_iostat", 00:05:43.922 "bdev_examine", 00:05:43.922 "bdev_wait_for_examine", 00:05:43.922 "bdev_set_options", 00:05:43.922 "notify_get_notifications", 00:05:43.922 "notify_get_types", 00:05:43.922 "accel_get_stats", 00:05:43.922 "accel_set_options", 00:05:43.922 "accel_set_driver", 00:05:43.922 "accel_crypto_key_destroy", 00:05:43.922 "accel_crypto_keys_get", 00:05:43.922 "accel_crypto_key_create", 00:05:43.922 "accel_assign_opc", 00:05:43.922 "accel_get_module_info", 00:05:43.922 "accel_get_opc_assignments", 00:05:43.922 "vmd_rescan", 00:05:43.922 "vmd_remove_device", 00:05:43.922 "vmd_enable", 00:05:43.922 "sock_get_default_impl", 00:05:43.922 "sock_set_default_impl", 00:05:43.922 "sock_impl_set_options", 00:05:43.922 "sock_impl_get_options", 00:05:43.922 "iobuf_get_stats", 00:05:43.922 "iobuf_set_options", 00:05:43.922 "framework_get_pci_devices", 00:05:43.922 "framework_get_config", 00:05:43.922 "framework_get_subsystems", 00:05:43.922 "trace_get_info", 00:05:43.922 "trace_get_tpoint_group_mask", 00:05:43.922 "trace_disable_tpoint_group", 00:05:43.922 "trace_enable_tpoint_group", 00:05:43.922 "trace_clear_tpoint_mask", 00:05:43.922 "trace_set_tpoint_mask", 00:05:43.922 "keyring_get_keys", 00:05:43.922 "spdk_get_version", 00:05:43.922 "rpc_get_methods" 00:05:43.922 ] 00:05:44.190 17:53:53 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:44.190 17:53:53 -- common/autotest_common.sh@726 -- # xtrace_disable 00:05:44.190 17:53:53 -- common/autotest_common.sh@10 -- # set +x 00:05:44.190 17:53:53 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:44.190 17:53:53 -- spdkcli/tcp.sh@38 -- # killprocess 833190 00:05:44.190 17:53:53 -- common/autotest_common.sh@946 -- # '[' -z 833190 ']' 00:05:44.190 17:53:53 -- common/autotest_common.sh@950 -- # kill -0 833190 00:05:44.190 17:53:53 -- common/autotest_common.sh@951 -- # uname 00:05:44.190 17:53:53 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:44.190 17:53:53 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 833190 00:05:44.191 17:53:53 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:44.191 17:53:53 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:44.191 17:53:53 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 833190' 00:05:44.191 killing process with pid 833190 00:05:44.191 17:53:53 -- common/autotest_common.sh@965 -- # kill 833190 00:05:44.191 17:53:53 -- common/autotest_common.sh@970 -- # wait 833190 00:05:44.450 00:05:44.450 real 0m1.618s 00:05:44.450 user 0m2.891s 00:05:44.450 sys 0m0.533s 00:05:44.450 17:53:53 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:44.450 17:53:53 -- common/autotest_common.sh@10 -- # set +x 00:05:44.450 ************************************ 00:05:44.450 END TEST spdkcli_tcp 00:05:44.450 ************************************ 00:05:44.450 17:53:53 -- spdk/autotest.sh@176 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:44.450 17:53:53 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:44.450 17:53:53 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:44.450 17:53:53 -- common/autotest_common.sh@10 -- # set +x 00:05:44.710 ************************************ 00:05:44.710 START TEST dpdk_mem_utility 00:05:44.710 ************************************ 00:05:44.710 17:53:53 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:44.710 * Looking for test storage... 00:05:44.970 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dpdk_memory_utility 00:05:44.970 17:53:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:44.970 17:53:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=833519 00:05:44.970 17:53:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 833519 00:05:44.970 17:53:53 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt 00:05:44.970 17:53:53 -- common/autotest_common.sh@827 -- # '[' -z 833519 ']' 00:05:44.970 17:53:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:44.970 17:53:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:44.970 17:53:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:44.970 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:44.970 17:53:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:44.970 17:53:53 -- common/autotest_common.sh@10 -- # set +x 00:05:44.970 [2024-04-26 17:53:53.956983] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:44.970 [2024-04-26 17:53:53.957049] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833519 ] 00:05:44.970 EAL: No free 2048 kB hugepages reported on node 1 00:05:44.970 [2024-04-26 17:53:54.027315] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:44.970 [2024-04-26 17:53:54.111658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.907 17:53:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:45.907 17:53:54 -- common/autotest_common.sh@860 -- # return 0 00:05:45.907 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:45.907 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:45.907 17:53:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:45.907 17:53:54 -- common/autotest_common.sh@10 -- # set +x 00:05:45.907 { 00:05:45.907 "filename": "/tmp/spdk_mem_dump.txt" 00:05:45.907 } 00:05:45.907 17:53:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:45.907 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:45.907 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:45.907 1 heaps totaling size 814.000000 MiB 00:05:45.907 size: 814.000000 MiB heap id: 0 00:05:45.907 end heaps---------- 00:05:45.907 8 mempools totaling size 598.116089 MiB 00:05:45.907 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:45.907 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:45.907 size: 84.521057 MiB name: bdev_io_833519 00:05:45.907 size: 51.011292 MiB name: evtpool_833519 00:05:45.907 size: 50.003479 MiB name: msgpool_833519 00:05:45.907 size: 21.763794 MiB name: PDU_Pool 00:05:45.907 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:45.907 size: 0.026123 MiB name: Session_Pool 00:05:45.907 end mempools------- 00:05:45.907 6 memzones totaling size 4.142822 MiB 00:05:45.907 size: 1.000366 MiB name: RG_ring_0_833519 00:05:45.907 size: 1.000366 MiB name: RG_ring_1_833519 00:05:45.907 size: 1.000366 MiB name: RG_ring_4_833519 00:05:45.907 size: 1.000366 MiB name: RG_ring_5_833519 00:05:45.907 size: 0.125366 MiB name: RG_ring_2_833519 00:05:45.907 size: 0.015991 MiB name: RG_ring_3_833519 00:05:45.907 end memzones------- 00:05:45.907 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:45.907 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:45.907 list of free elements. size: 12.519348 MiB 00:05:45.907 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:45.907 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:45.907 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:45.907 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:45.907 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:45.908 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:45.908 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:45.908 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:45.908 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:45.908 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:45.908 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:45.908 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:45.908 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:45.908 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:45.908 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:45.908 list of standard malloc elements. size: 199.218079 MiB 00:05:45.908 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:45.908 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:45.908 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:45.908 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:45.908 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:45.908 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:45.908 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:45.908 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:45.908 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:45.908 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:45.908 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:45.908 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:45.908 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:45.908 list of memzone associated elements. size: 602.262573 MiB 00:05:45.908 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:45.908 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:45.908 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:45.908 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:45.908 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:45.908 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_833519_0 00:05:45.908 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:45.908 associated memzone info: size: 48.002930 MiB name: MP_evtpool_833519_0 00:05:45.908 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:45.908 associated memzone info: size: 48.002930 MiB name: MP_msgpool_833519_0 00:05:45.908 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:45.908 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:45.908 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:45.908 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:45.908 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:45.908 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_833519 00:05:45.908 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:45.908 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_833519 00:05:45.908 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:45.908 associated memzone info: size: 1.007996 MiB name: MP_evtpool_833519 00:05:45.908 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:45.908 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:45.908 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:45.908 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:45.908 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:45.908 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:45.908 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:45.908 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:45.908 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:45.908 associated memzone info: size: 1.000366 MiB name: RG_ring_0_833519 00:05:45.908 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:45.908 associated memzone info: size: 1.000366 MiB name: RG_ring_1_833519 00:05:45.908 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:45.908 associated memzone info: size: 1.000366 MiB name: RG_ring_4_833519 00:05:45.908 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:45.908 associated memzone info: size: 1.000366 MiB name: RG_ring_5_833519 00:05:45.908 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:45.908 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_833519 00:05:45.908 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:45.908 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:45.908 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:45.908 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:45.908 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:45.908 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:45.908 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:45.908 associated memzone info: size: 0.125366 MiB name: RG_ring_2_833519 00:05:45.908 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:45.908 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:45.908 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:45.908 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:45.908 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:45.908 associated memzone info: size: 0.015991 MiB name: RG_ring_3_833519 00:05:45.908 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:45.908 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:45.908 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:45.908 associated memzone info: size: 0.000183 MiB name: MP_msgpool_833519 00:05:45.908 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:45.908 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_833519 00:05:45.908 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:45.908 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:45.908 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:45.908 17:53:54 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 833519 00:05:45.908 17:53:54 -- common/autotest_common.sh@946 -- # '[' -z 833519 ']' 00:05:45.908 17:53:54 -- common/autotest_common.sh@950 -- # kill -0 833519 00:05:45.908 17:53:54 -- common/autotest_common.sh@951 -- # uname 00:05:45.908 17:53:54 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:45.908 17:53:54 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 833519 00:05:45.908 17:53:54 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:05:45.908 17:53:54 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:05:45.908 17:53:54 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 833519' 00:05:45.908 killing process with pid 833519 00:05:45.908 17:53:54 -- common/autotest_common.sh@965 -- # kill 833519 00:05:45.908 17:53:54 -- common/autotest_common.sh@970 -- # wait 833519 00:05:46.167 00:05:46.167 real 0m1.505s 00:05:46.167 user 0m1.517s 00:05:46.167 sys 0m0.469s 00:05:46.167 17:53:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:46.167 17:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:46.167 ************************************ 00:05:46.167 END TEST dpdk_mem_utility 00:05:46.167 ************************************ 00:05:46.167 17:53:55 -- spdk/autotest.sh@177 -- # run_test event /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:46.167 17:53:55 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:46.167 17:53:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:46.167 17:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:46.426 ************************************ 00:05:46.426 START TEST event 00:05:46.426 ************************************ 00:05:46.426 17:53:55 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event.sh 00:05:46.426 * Looking for test storage... 00:05:46.426 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:05:46.426 17:53:55 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:46.426 17:53:55 -- bdev/nbd_common.sh@6 -- # set -e 00:05:46.426 17:53:55 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:46.426 17:53:55 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:05:46.426 17:53:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:46.426 17:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:46.685 ************************************ 00:05:46.685 START TEST event_perf 00:05:46.685 ************************************ 00:05:46.685 17:53:55 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:46.685 Running I/O for 1 seconds...[2024-04-26 17:53:55.739492] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:46.685 [2024-04-26 17:53:55.739571] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833776 ] 00:05:46.685 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.685 [2024-04-26 17:53:55.810698] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:46.945 [2024-04-26 17:53:55.897077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.945 [2024-04-26 17:53:55.897166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:46.945 [2024-04-26 17:53:55.897242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:46.945 [2024-04-26 17:53:55.897244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.882 Running I/O for 1 seconds... 00:05:47.882 lcore 0: 209614 00:05:47.882 lcore 1: 209615 00:05:47.882 lcore 2: 209612 00:05:47.882 lcore 3: 209613 00:05:47.882 done. 00:05:47.882 00:05:47.882 real 0m1.278s 00:05:47.882 user 0m4.191s 00:05:47.882 sys 0m0.082s 00:05:47.882 17:53:56 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:47.882 17:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:47.882 ************************************ 00:05:47.882 END TEST event_perf 00:05:47.882 ************************************ 00:05:47.882 17:53:57 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:47.882 17:53:57 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:05:47.882 17:53:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:47.882 17:53:57 -- common/autotest_common.sh@10 -- # set +x 00:05:48.142 ************************************ 00:05:48.142 START TEST event_reactor 00:05:48.142 ************************************ 00:05:48.142 17:53:57 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:48.142 [2024-04-26 17:53:57.190082] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:48.142 [2024-04-26 17:53:57.190150] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833994 ] 00:05:48.142 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.142 [2024-04-26 17:53:57.262306] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.399 [2024-04-26 17:53:57.345854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.334 test_start 00:05:49.334 oneshot 00:05:49.334 tick 100 00:05:49.334 tick 100 00:05:49.334 tick 250 00:05:49.334 tick 100 00:05:49.334 tick 100 00:05:49.334 tick 250 00:05:49.334 tick 100 00:05:49.334 tick 500 00:05:49.334 tick 100 00:05:49.334 tick 100 00:05:49.334 tick 250 00:05:49.334 tick 100 00:05:49.334 tick 100 00:05:49.334 test_end 00:05:49.334 00:05:49.334 real 0m1.270s 00:05:49.334 user 0m1.170s 00:05:49.334 sys 0m0.095s 00:05:49.334 17:53:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:49.334 17:53:58 -- common/autotest_common.sh@10 -- # set +x 00:05:49.334 ************************************ 00:05:49.334 END TEST event_reactor 00:05:49.334 ************************************ 00:05:49.334 17:53:58 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:49.334 17:53:58 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:05:49.334 17:53:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:49.334 17:53:58 -- common/autotest_common.sh@10 -- # set +x 00:05:49.594 ************************************ 00:05:49.594 START TEST event_reactor_perf 00:05:49.594 ************************************ 00:05:49.594 17:53:58 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:49.594 [2024-04-26 17:53:58.650104] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:49.594 [2024-04-26 17:53:58.650185] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid834198 ] 00:05:49.594 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.594 [2024-04-26 17:53:58.725861] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.852 [2024-04-26 17:53:58.810384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.788 test_start 00:05:50.788 test_end 00:05:50.788 Performance: 515561 events per second 00:05:50.788 00:05:50.788 real 0m1.282s 00:05:50.788 user 0m1.184s 00:05:50.788 sys 0m0.093s 00:05:50.788 17:53:59 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:50.788 17:53:59 -- common/autotest_common.sh@10 -- # set +x 00:05:50.788 ************************************ 00:05:50.788 END TEST event_reactor_perf 00:05:50.788 ************************************ 00:05:50.788 17:53:59 -- event/event.sh@49 -- # uname -s 00:05:50.788 17:53:59 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:50.788 17:53:59 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:50.788 17:53:59 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:50.788 17:53:59 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:50.788 17:53:59 -- common/autotest_common.sh@10 -- # set +x 00:05:51.046 ************************************ 00:05:51.046 START TEST event_scheduler 00:05:51.046 ************************************ 00:05:51.046 17:54:00 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:51.046 * Looking for test storage... 00:05:51.047 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler 00:05:51.047 17:54:00 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:51.047 17:54:00 -- scheduler/scheduler.sh@35 -- # scheduler_pid=834512 00:05:51.047 17:54:00 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:51.047 17:54:00 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:51.047 17:54:00 -- scheduler/scheduler.sh@37 -- # waitforlisten 834512 00:05:51.047 17:54:00 -- common/autotest_common.sh@827 -- # '[' -z 834512 ']' 00:05:51.047 17:54:00 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:51.047 17:54:00 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:51.047 17:54:00 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:51.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:51.047 17:54:00 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:51.047 17:54:00 -- common/autotest_common.sh@10 -- # set +x 00:05:51.305 [2024-04-26 17:54:00.259533] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:51.305 [2024-04-26 17:54:00.259596] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid834512 ] 00:05:51.305 EAL: No free 2048 kB hugepages reported on node 1 00:05:51.305 [2024-04-26 17:54:00.338079] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:51.305 [2024-04-26 17:54:00.430059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:51.305 [2024-04-26 17:54:00.430146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:51.305 [2024-04-26 17:54:00.430223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:51.305 [2024-04-26 17:54:00.430225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:52.241 17:54:01 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:52.241 17:54:01 -- common/autotest_common.sh@860 -- # return 0 00:05:52.241 17:54:01 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:52.241 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.241 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.241 POWER: Env isn't set yet! 00:05:52.241 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:52.241 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:05:52.241 POWER: Cannot set governor of lcore 0 to userspace 00:05:52.241 POWER: Attempting to initialise PSTAT power management... 00:05:52.241 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:52.241 POWER: Initialized successfully for lcore 0 power management 00:05:52.241 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:52.241 POWER: Initialized successfully for lcore 1 power management 00:05:52.241 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:52.241 POWER: Initialized successfully for lcore 2 power management 00:05:52.241 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:52.241 POWER: Initialized successfully for lcore 3 power management 00:05:52.241 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.241 17:54:01 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:52.241 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 [2024-04-26 17:54:01.196802] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:52.242 17:54:01 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:52.242 17:54:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 ************************************ 00:05:52.242 START TEST scheduler_create_thread 00:05:52.242 ************************************ 00:05:52.242 17:54:01 -- common/autotest_common.sh@1121 -- # scheduler_create_thread 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 2 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 3 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 4 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 5 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 6 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 7 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 8 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 9 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.242 17:54:01 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:52.242 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.242 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.242 10 00:05:52.242 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.500 17:54:01 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:52.500 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.500 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.500 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.500 17:54:01 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:52.500 17:54:01 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:52.500 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.500 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:52.760 17:54:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:52.760 17:54:01 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:52.760 17:54:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:52.760 17:54:01 -- common/autotest_common.sh@10 -- # set +x 00:05:54.660 17:54:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:54.660 17:54:03 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:54.660 17:54:03 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:54.660 17:54:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:05:54.660 17:54:03 -- common/autotest_common.sh@10 -- # set +x 00:05:55.597 17:54:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:05:55.597 00:05:55.597 real 0m3.103s 00:05:55.597 user 0m0.021s 00:05:55.597 sys 0m0.007s 00:05:55.597 17:54:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:55.597 17:54:04 -- common/autotest_common.sh@10 -- # set +x 00:05:55.597 ************************************ 00:05:55.597 END TEST scheduler_create_thread 00:05:55.597 ************************************ 00:05:55.597 17:54:04 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:55.597 17:54:04 -- scheduler/scheduler.sh@46 -- # killprocess 834512 00:05:55.597 17:54:04 -- common/autotest_common.sh@946 -- # '[' -z 834512 ']' 00:05:55.597 17:54:04 -- common/autotest_common.sh@950 -- # kill -0 834512 00:05:55.597 17:54:04 -- common/autotest_common.sh@951 -- # uname 00:05:55.597 17:54:04 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:05:55.597 17:54:04 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 834512 00:05:55.597 17:54:04 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:05:55.597 17:54:04 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:05:55.597 17:54:04 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 834512' 00:05:55.597 killing process with pid 834512 00:05:55.597 17:54:04 -- common/autotest_common.sh@965 -- # kill 834512 00:05:55.597 17:54:04 -- common/autotest_common.sh@970 -- # wait 834512 00:05:55.856 [2024-04-26 17:54:04.824622] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:55.856 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:55.856 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:55.856 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:55.856 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:55.856 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:55.856 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:55.856 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:55.856 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:56.115 00:05:56.115 real 0m4.981s 00:05:56.115 user 0m9.550s 00:05:56.115 sys 0m0.530s 00:05:56.115 17:54:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:05:56.115 17:54:05 -- common/autotest_common.sh@10 -- # set +x 00:05:56.115 ************************************ 00:05:56.115 END TEST event_scheduler 00:05:56.115 ************************************ 00:05:56.115 17:54:05 -- event/event.sh@51 -- # modprobe -n nbd 00:05:56.115 17:54:05 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:56.115 17:54:05 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:05:56.115 17:54:05 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:05:56.115 17:54:05 -- common/autotest_common.sh@10 -- # set +x 00:05:56.115 ************************************ 00:05:56.115 START TEST app_repeat 00:05:56.115 ************************************ 00:05:56.115 17:54:05 -- common/autotest_common.sh@1121 -- # app_repeat_test 00:05:56.115 17:54:05 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:56.115 17:54:05 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:56.115 17:54:05 -- event/event.sh@13 -- # local nbd_list 00:05:56.115 17:54:05 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:56.115 17:54:05 -- event/event.sh@14 -- # local bdev_list 00:05:56.115 17:54:05 -- event/event.sh@15 -- # local repeat_times=4 00:05:56.115 17:54:05 -- event/event.sh@17 -- # modprobe nbd 00:05:56.115 17:54:05 -- event/event.sh@19 -- # repeat_pid=835619 00:05:56.115 17:54:05 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:56.115 17:54:05 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 835619' 00:05:56.115 Process app_repeat pid: 835619 00:05:56.115 17:54:05 -- event/event.sh@23 -- # for i in {0..2} 00:05:56.115 17:54:05 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:56.115 spdk_app_start Round 0 00:05:56.115 17:54:05 -- event/event.sh@25 -- # waitforlisten 835619 /var/tmp/spdk-nbd.sock 00:05:56.115 17:54:05 -- common/autotest_common.sh@827 -- # '[' -z 835619 ']' 00:05:56.115 17:54:05 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:56.115 17:54:05 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:56.115 17:54:05 -- common/autotest_common.sh@832 -- # local max_retries=100 00:05:56.115 17:54:05 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:56.115 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:56.115 17:54:05 -- common/autotest_common.sh@836 -- # xtrace_disable 00:05:56.115 17:54:05 -- common/autotest_common.sh@10 -- # set +x 00:05:56.115 [2024-04-26 17:54:05.302464] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:05:56.115 [2024-04-26 17:54:05.302534] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid835619 ] 00:05:56.374 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.374 [2024-04-26 17:54:05.374908] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.374 [2024-04-26 17:54:05.454384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.374 [2024-04-26 17:54:05.454386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.942 17:54:06 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:05:56.942 17:54:06 -- common/autotest_common.sh@860 -- # return 0 00:05:56.942 17:54:06 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.200 Malloc0 00:05:57.200 17:54:06 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:57.460 Malloc1 00:05:57.460 17:54:06 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@12 -- # local i 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.460 17:54:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:57.719 /dev/nbd0 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:57.719 17:54:06 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:05:57.719 17:54:06 -- common/autotest_common.sh@865 -- # local i 00:05:57.719 17:54:06 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:05:57.719 17:54:06 -- common/autotest_common.sh@869 -- # break 00:05:57.719 17:54:06 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.719 1+0 records in 00:05:57.719 1+0 records out 00:05:57.719 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000224422 s, 18.3 MB/s 00:05:57.719 17:54:06 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:57.719 17:54:06 -- common/autotest_common.sh@882 -- # size=4096 00:05:57.719 17:54:06 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:57.719 17:54:06 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:57.719 17:54:06 -- common/autotest_common.sh@885 -- # return 0 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:57.719 /dev/nbd1 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:57.719 17:54:06 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:57.719 17:54:06 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:05:57.719 17:54:06 -- common/autotest_common.sh@865 -- # local i 00:05:57.719 17:54:06 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:05:57.719 17:54:06 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:05:57.978 17:54:06 -- common/autotest_common.sh@869 -- # break 00:05:57.978 17:54:06 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:05:57.978 17:54:06 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:05:57.978 17:54:06 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:57.978 1+0 records in 00:05:57.978 1+0 records out 00:05:57.978 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000237879 s, 17.2 MB/s 00:05:57.978 17:54:06 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:57.978 17:54:06 -- common/autotest_common.sh@882 -- # size=4096 00:05:57.978 17:54:06 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:05:57.978 17:54:06 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:05:57.978 17:54:06 -- common/autotest_common.sh@885 -- # return 0 00:05:57.978 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:57.978 17:54:06 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:57.978 17:54:06 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:57.978 17:54:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:57.978 17:54:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:57.978 { 00:05:57.978 "nbd_device": "/dev/nbd0", 00:05:57.978 "bdev_name": "Malloc0" 00:05:57.978 }, 00:05:57.978 { 00:05:57.978 "nbd_device": "/dev/nbd1", 00:05:57.978 "bdev_name": "Malloc1" 00:05:57.978 } 00:05:57.978 ]' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:57.978 { 00:05:57.978 "nbd_device": "/dev/nbd0", 00:05:57.978 "bdev_name": "Malloc0" 00:05:57.978 }, 00:05:57.978 { 00:05:57.978 "nbd_device": "/dev/nbd1", 00:05:57.978 "bdev_name": "Malloc1" 00:05:57.978 } 00:05:57.978 ]' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:57.978 /dev/nbd1' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:57.978 /dev/nbd1' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@65 -- # count=2 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@95 -- # count=2 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:57.978 17:54:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:58.237 256+0 records in 00:05:58.237 256+0 records out 00:05:58.237 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00498365 s, 210 MB/s 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:58.237 256+0 records in 00:05:58.237 256+0 records out 00:05:58.237 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195565 s, 53.6 MB/s 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:58.237 256+0 records in 00:05:58.237 256+0 records out 00:05:58.237 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213304 s, 49.2 MB/s 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:58.237 17:54:07 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@51 -- # local i 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.238 17:54:07 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@41 -- # break 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@41 -- # break 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@45 -- # return 0 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:58.497 17:54:07 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@65 -- # true 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@65 -- # count=0 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@104 -- # count=0 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:58.755 17:54:07 -- bdev/nbd_common.sh@109 -- # return 0 00:05:58.755 17:54:07 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:59.015 17:54:08 -- event/event.sh@35 -- # sleep 3 00:05:59.274 [2024-04-26 17:54:08.299326] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:59.274 [2024-04-26 17:54:08.378519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.274 [2024-04-26 17:54:08.378524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.274 [2024-04-26 17:54:08.426885] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:59.274 [2024-04-26 17:54:08.426932] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:02.637 17:54:11 -- event/event.sh@23 -- # for i in {0..2} 00:06:02.637 17:54:11 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:02.637 spdk_app_start Round 1 00:06:02.637 17:54:11 -- event/event.sh@25 -- # waitforlisten 835619 /var/tmp/spdk-nbd.sock 00:06:02.637 17:54:11 -- common/autotest_common.sh@827 -- # '[' -z 835619 ']' 00:06:02.637 17:54:11 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:02.637 17:54:11 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:02.637 17:54:11 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:02.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:02.637 17:54:11 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:02.637 17:54:11 -- common/autotest_common.sh@10 -- # set +x 00:06:02.637 17:54:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:02.637 17:54:11 -- common/autotest_common.sh@860 -- # return 0 00:06:02.637 17:54:11 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.637 Malloc0 00:06:02.637 17:54:11 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:02.637 Malloc1 00:06:02.637 17:54:11 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@12 -- # local i 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:02.637 17:54:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.638 17:54:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:02.638 /dev/nbd0 00:06:02.896 17:54:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:02.896 17:54:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:02.896 17:54:11 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:06:02.896 17:54:11 -- common/autotest_common.sh@865 -- # local i 00:06:02.896 17:54:11 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:06:02.896 17:54:11 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:06:02.896 17:54:11 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:06:02.896 17:54:11 -- common/autotest_common.sh@869 -- # break 00:06:02.896 17:54:11 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:06:02.896 17:54:11 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:06:02.896 17:54:11 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:02.896 1+0 records in 00:06:02.896 1+0 records out 00:06:02.896 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000241182 s, 17.0 MB/s 00:06:02.896 17:54:11 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:02.896 17:54:11 -- common/autotest_common.sh@882 -- # size=4096 00:06:02.896 17:54:11 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:02.896 17:54:11 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:06:02.896 17:54:11 -- common/autotest_common.sh@885 -- # return 0 00:06:02.896 17:54:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:02.896 17:54:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.896 17:54:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:02.896 /dev/nbd1 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:02.896 17:54:12 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:06:02.896 17:54:12 -- common/autotest_common.sh@865 -- # local i 00:06:02.896 17:54:12 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:06:02.896 17:54:12 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:06:02.896 17:54:12 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:06:02.896 17:54:12 -- common/autotest_common.sh@869 -- # break 00:06:02.896 17:54:12 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:06:02.896 17:54:12 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:06:02.896 17:54:12 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:02.896 1+0 records in 00:06:02.896 1+0 records out 00:06:02.896 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00016707 s, 24.5 MB/s 00:06:02.896 17:54:12 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:02.896 17:54:12 -- common/autotest_common.sh@882 -- # size=4096 00:06:02.896 17:54:12 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:02.896 17:54:12 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:06:02.896 17:54:12 -- common/autotest_common.sh@885 -- # return 0 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:02.896 17:54:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:03.155 { 00:06:03.155 "nbd_device": "/dev/nbd0", 00:06:03.155 "bdev_name": "Malloc0" 00:06:03.155 }, 00:06:03.155 { 00:06:03.155 "nbd_device": "/dev/nbd1", 00:06:03.155 "bdev_name": "Malloc1" 00:06:03.155 } 00:06:03.155 ]' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:03.155 { 00:06:03.155 "nbd_device": "/dev/nbd0", 00:06:03.155 "bdev_name": "Malloc0" 00:06:03.155 }, 00:06:03.155 { 00:06:03.155 "nbd_device": "/dev/nbd1", 00:06:03.155 "bdev_name": "Malloc1" 00:06:03.155 } 00:06:03.155 ]' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:03.155 /dev/nbd1' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:03.155 /dev/nbd1' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@65 -- # count=2 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@95 -- # count=2 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:03.155 256+0 records in 00:06:03.155 256+0 records out 00:06:03.155 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00358282 s, 293 MB/s 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:03.155 256+0 records in 00:06:03.155 256+0 records out 00:06:03.155 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200746 s, 52.2 MB/s 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:03.155 17:54:12 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:03.415 256+0 records in 00:06:03.415 256+0 records out 00:06:03.415 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212531 s, 49.3 MB/s 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@51 -- # local i 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@41 -- # break 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:03.415 17:54:12 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@41 -- # break 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:03.674 17:54:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:03.933 17:54:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:03.933 17:54:12 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:03.933 17:54:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@65 -- # true 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@65 -- # count=0 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@104 -- # count=0 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:03.933 17:54:13 -- bdev/nbd_common.sh@109 -- # return 0 00:06:03.933 17:54:13 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:04.192 17:54:13 -- event/event.sh@35 -- # sleep 3 00:06:04.451 [2024-04-26 17:54:13.435627] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:04.451 [2024-04-26 17:54:13.514247] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:04.451 [2024-04-26 17:54:13.514249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.451 [2024-04-26 17:54:13.563490] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:04.451 [2024-04-26 17:54:13.563535] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:07.737 17:54:16 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.737 17:54:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:07.737 spdk_app_start Round 2 00:06:07.737 17:54:16 -- event/event.sh@25 -- # waitforlisten 835619 /var/tmp/spdk-nbd.sock 00:06:07.737 17:54:16 -- common/autotest_common.sh@827 -- # '[' -z 835619 ']' 00:06:07.737 17:54:16 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.737 17:54:16 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:07.737 17:54:16 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.737 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.737 17:54:16 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:07.737 17:54:16 -- common/autotest_common.sh@10 -- # set +x 00:06:07.737 17:54:16 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:07.737 17:54:16 -- common/autotest_common.sh@860 -- # return 0 00:06:07.737 17:54:16 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.737 Malloc0 00:06:07.737 17:54:16 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:07.737 Malloc1 00:06:07.737 17:54:16 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@12 -- # local i 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.737 17:54:16 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:07.995 /dev/nbd0 00:06:07.995 17:54:16 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:07.995 17:54:16 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:07.995 17:54:16 -- common/autotest_common.sh@864 -- # local nbd_name=nbd0 00:06:07.995 17:54:16 -- common/autotest_common.sh@865 -- # local i 00:06:07.995 17:54:16 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:06:07.995 17:54:16 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:06:07.995 17:54:16 -- common/autotest_common.sh@868 -- # grep -q -w nbd0 /proc/partitions 00:06:07.995 17:54:16 -- common/autotest_common.sh@869 -- # break 00:06:07.995 17:54:16 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:06:07.995 17:54:16 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:06:07.995 17:54:16 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:07.995 1+0 records in 00:06:07.995 1+0 records out 00:06:07.995 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000230606 s, 17.8 MB/s 00:06:07.995 17:54:16 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:07.995 17:54:16 -- common/autotest_common.sh@882 -- # size=4096 00:06:07.995 17:54:16 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:07.995 17:54:16 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:06:07.995 17:54:16 -- common/autotest_common.sh@885 -- # return 0 00:06:07.995 17:54:16 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:07.995 17:54:16 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:07.995 17:54:16 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:07.995 /dev/nbd1 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:08.254 17:54:17 -- common/autotest_common.sh@864 -- # local nbd_name=nbd1 00:06:08.254 17:54:17 -- common/autotest_common.sh@865 -- # local i 00:06:08.254 17:54:17 -- common/autotest_common.sh@867 -- # (( i = 1 )) 00:06:08.254 17:54:17 -- common/autotest_common.sh@867 -- # (( i <= 20 )) 00:06:08.254 17:54:17 -- common/autotest_common.sh@868 -- # grep -q -w nbd1 /proc/partitions 00:06:08.254 17:54:17 -- common/autotest_common.sh@869 -- # break 00:06:08.254 17:54:17 -- common/autotest_common.sh@880 -- # (( i = 1 )) 00:06:08.254 17:54:17 -- common/autotest_common.sh@880 -- # (( i <= 20 )) 00:06:08.254 17:54:17 -- common/autotest_common.sh@881 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.254 1+0 records in 00:06:08.254 1+0 records out 00:06:08.254 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000242358 s, 16.9 MB/s 00:06:08.254 17:54:17 -- common/autotest_common.sh@882 -- # stat -c %s /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:08.254 17:54:17 -- common/autotest_common.sh@882 -- # size=4096 00:06:08.254 17:54:17 -- common/autotest_common.sh@883 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdtest 00:06:08.254 17:54:17 -- common/autotest_common.sh@884 -- # '[' 4096 '!=' 0 ']' 00:06:08.254 17:54:17 -- common/autotest_common.sh@885 -- # return 0 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:08.254 { 00:06:08.254 "nbd_device": "/dev/nbd0", 00:06:08.254 "bdev_name": "Malloc0" 00:06:08.254 }, 00:06:08.254 { 00:06:08.254 "nbd_device": "/dev/nbd1", 00:06:08.254 "bdev_name": "Malloc1" 00:06:08.254 } 00:06:08.254 ]' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:08.254 { 00:06:08.254 "nbd_device": "/dev/nbd0", 00:06:08.254 "bdev_name": "Malloc0" 00:06:08.254 }, 00:06:08.254 { 00:06:08.254 "nbd_device": "/dev/nbd1", 00:06:08.254 "bdev_name": "Malloc1" 00:06:08.254 } 00:06:08.254 ]' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:08.254 /dev/nbd1' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:08.254 /dev/nbd1' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@65 -- # count=2 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@95 -- # count=2 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:08.254 17:54:17 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:08.513 256+0 records in 00:06:08.513 256+0 records out 00:06:08.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111634 s, 93.9 MB/s 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:08.513 256+0 records in 00:06:08.513 256+0 records out 00:06:08.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202969 s, 51.7 MB/s 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:08.513 256+0 records in 00:06:08.513 256+0 records out 00:06:08.513 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02145 s, 48.9 MB/s 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/nbdrandtest 00:06:08.513 17:54:17 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@51 -- # local i 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.514 17:54:17 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:08.772 17:54:17 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@41 -- # break 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@41 -- # break 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@45 -- # return 0 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.773 17:54:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@65 -- # true 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@65 -- # count=0 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@104 -- # count=0 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:09.032 17:54:18 -- bdev/nbd_common.sh@109 -- # return 0 00:06:09.032 17:54:18 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:09.291 17:54:18 -- event/event.sh@35 -- # sleep 3 00:06:09.550 [2024-04-26 17:54:18.564048] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:09.550 [2024-04-26 17:54:18.640683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:09.550 [2024-04-26 17:54:18.640686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.550 [2024-04-26 17:54:18.688999] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:09.550 [2024-04-26 17:54:18.689049] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:12.837 17:54:21 -- event/event.sh@38 -- # waitforlisten 835619 /var/tmp/spdk-nbd.sock 00:06:12.837 17:54:21 -- common/autotest_common.sh@827 -- # '[' -z 835619 ']' 00:06:12.837 17:54:21 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:12.837 17:54:21 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:12.837 17:54:21 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:12.837 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:12.837 17:54:21 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:12.837 17:54:21 -- common/autotest_common.sh@10 -- # set +x 00:06:12.837 17:54:21 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:12.837 17:54:21 -- common/autotest_common.sh@860 -- # return 0 00:06:12.837 17:54:21 -- event/event.sh@39 -- # killprocess 835619 00:06:12.837 17:54:21 -- common/autotest_common.sh@946 -- # '[' -z 835619 ']' 00:06:12.837 17:54:21 -- common/autotest_common.sh@950 -- # kill -0 835619 00:06:12.837 17:54:21 -- common/autotest_common.sh@951 -- # uname 00:06:12.837 17:54:21 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:12.837 17:54:21 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 835619 00:06:12.837 17:54:21 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:12.837 17:54:21 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:12.837 17:54:21 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 835619' 00:06:12.837 killing process with pid 835619 00:06:12.837 17:54:21 -- common/autotest_common.sh@965 -- # kill 835619 00:06:12.837 17:54:21 -- common/autotest_common.sh@970 -- # wait 835619 00:06:12.837 spdk_app_start is called in Round 0. 00:06:12.837 Shutdown signal received, stop current app iteration 00:06:12.837 Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 reinitialization... 00:06:12.837 spdk_app_start is called in Round 1. 00:06:12.837 Shutdown signal received, stop current app iteration 00:06:12.837 Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 reinitialization... 00:06:12.837 spdk_app_start is called in Round 2. 00:06:12.837 Shutdown signal received, stop current app iteration 00:06:12.837 Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 reinitialization... 00:06:12.837 spdk_app_start is called in Round 3. 00:06:12.837 Shutdown signal received, stop current app iteration 00:06:12.837 17:54:21 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:12.837 17:54:21 -- event/event.sh@42 -- # return 0 00:06:12.837 00:06:12.837 real 0m16.515s 00:06:12.837 user 0m35.087s 00:06:12.837 sys 0m3.046s 00:06:12.837 17:54:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:12.837 17:54:21 -- common/autotest_common.sh@10 -- # set +x 00:06:12.837 ************************************ 00:06:12.837 END TEST app_repeat 00:06:12.837 ************************************ 00:06:12.837 17:54:21 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:12.837 17:54:21 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:12.837 17:54:21 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:12.837 17:54:21 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:12.837 17:54:21 -- common/autotest_common.sh@10 -- # set +x 00:06:12.837 ************************************ 00:06:12.837 START TEST cpu_locks 00:06:12.837 ************************************ 00:06:12.837 17:54:21 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:13.097 * Looking for test storage... 00:06:13.097 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/event 00:06:13.097 17:54:22 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:13.097 17:54:22 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:13.097 17:54:22 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:13.097 17:54:22 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:13.097 17:54:22 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:13.097 17:54:22 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:13.097 17:54:22 -- common/autotest_common.sh@10 -- # set +x 00:06:13.097 ************************************ 00:06:13.097 START TEST default_locks 00:06:13.097 ************************************ 00:06:13.097 17:54:22 -- common/autotest_common.sh@1121 -- # default_locks 00:06:13.097 17:54:22 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=838323 00:06:13.097 17:54:22 -- event/cpu_locks.sh@47 -- # waitforlisten 838323 00:06:13.097 17:54:22 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:13.097 17:54:22 -- common/autotest_common.sh@827 -- # '[' -z 838323 ']' 00:06:13.097 17:54:22 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:13.097 17:54:22 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:13.097 17:54:22 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:13.097 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:13.097 17:54:22 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:13.097 17:54:22 -- common/autotest_common.sh@10 -- # set +x 00:06:13.356 [2024-04-26 17:54:22.307494] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:13.356 [2024-04-26 17:54:22.307543] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838323 ] 00:06:13.356 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.356 [2024-04-26 17:54:22.379476] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.356 [2024-04-26 17:54:22.459052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.924 17:54:23 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:13.924 17:54:23 -- common/autotest_common.sh@860 -- # return 0 00:06:13.924 17:54:23 -- event/cpu_locks.sh@49 -- # locks_exist 838323 00:06:13.924 17:54:23 -- event/cpu_locks.sh@22 -- # lslocks -p 838323 00:06:13.924 17:54:23 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:14.866 lslocks: write error 00:06:14.866 17:54:23 -- event/cpu_locks.sh@50 -- # killprocess 838323 00:06:14.866 17:54:23 -- common/autotest_common.sh@946 -- # '[' -z 838323 ']' 00:06:14.866 17:54:23 -- common/autotest_common.sh@950 -- # kill -0 838323 00:06:14.866 17:54:23 -- common/autotest_common.sh@951 -- # uname 00:06:14.866 17:54:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:14.866 17:54:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 838323 00:06:14.866 17:54:23 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:14.866 17:54:23 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:14.866 17:54:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 838323' 00:06:14.866 killing process with pid 838323 00:06:14.866 17:54:23 -- common/autotest_common.sh@965 -- # kill 838323 00:06:14.866 17:54:23 -- common/autotest_common.sh@970 -- # wait 838323 00:06:15.125 17:54:24 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 838323 00:06:15.125 17:54:24 -- common/autotest_common.sh@648 -- # local es=0 00:06:15.125 17:54:24 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 838323 00:06:15.125 17:54:24 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:06:15.125 17:54:24 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:15.125 17:54:24 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:06:15.125 17:54:24 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:15.125 17:54:24 -- common/autotest_common.sh@651 -- # waitforlisten 838323 00:06:15.125 17:54:24 -- common/autotest_common.sh@827 -- # '[' -z 838323 ']' 00:06:15.125 17:54:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.125 17:54:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:15.125 17:54:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.125 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.125 17:54:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:15.125 17:54:24 -- common/autotest_common.sh@10 -- # set +x 00:06:15.125 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (838323) - No such process 00:06:15.125 ERROR: process (pid: 838323) is no longer running 00:06:15.125 17:54:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:15.125 17:54:24 -- common/autotest_common.sh@860 -- # return 1 00:06:15.125 17:54:24 -- common/autotest_common.sh@651 -- # es=1 00:06:15.125 17:54:24 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:15.125 17:54:24 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:15.125 17:54:24 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:15.125 17:54:24 -- event/cpu_locks.sh@54 -- # no_locks 00:06:15.125 17:54:24 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:15.125 17:54:24 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:15.125 17:54:24 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:15.125 00:06:15.125 real 0m1.939s 00:06:15.125 user 0m1.995s 00:06:15.125 sys 0m0.726s 00:06:15.125 17:54:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:15.125 17:54:24 -- common/autotest_common.sh@10 -- # set +x 00:06:15.125 ************************************ 00:06:15.125 END TEST default_locks 00:06:15.125 ************************************ 00:06:15.125 17:54:24 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:15.125 17:54:24 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:15.125 17:54:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:15.125 17:54:24 -- common/autotest_common.sh@10 -- # set +x 00:06:15.384 ************************************ 00:06:15.384 START TEST default_locks_via_rpc 00:06:15.384 ************************************ 00:06:15.384 17:54:24 -- common/autotest_common.sh@1121 -- # default_locks_via_rpc 00:06:15.384 17:54:24 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=838555 00:06:15.384 17:54:24 -- event/cpu_locks.sh@63 -- # waitforlisten 838555 00:06:15.384 17:54:24 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:15.384 17:54:24 -- common/autotest_common.sh@827 -- # '[' -z 838555 ']' 00:06:15.385 17:54:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.385 17:54:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:15.385 17:54:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.385 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.385 17:54:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:15.385 17:54:24 -- common/autotest_common.sh@10 -- # set +x 00:06:15.385 [2024-04-26 17:54:24.448450] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:15.385 [2024-04-26 17:54:24.448507] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838555 ] 00:06:15.385 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.385 [2024-04-26 17:54:24.519826] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.644 [2024-04-26 17:54:24.606245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.210 17:54:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:16.210 17:54:25 -- common/autotest_common.sh@860 -- # return 0 00:06:16.210 17:54:25 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:16.210 17:54:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:16.210 17:54:25 -- common/autotest_common.sh@10 -- # set +x 00:06:16.210 17:54:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:16.210 17:54:25 -- event/cpu_locks.sh@67 -- # no_locks 00:06:16.210 17:54:25 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:16.210 17:54:25 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:16.210 17:54:25 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:16.210 17:54:25 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:16.210 17:54:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:16.210 17:54:25 -- common/autotest_common.sh@10 -- # set +x 00:06:16.210 17:54:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:16.210 17:54:25 -- event/cpu_locks.sh@71 -- # locks_exist 838555 00:06:16.210 17:54:25 -- event/cpu_locks.sh@22 -- # lslocks -p 838555 00:06:16.210 17:54:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:16.470 17:54:25 -- event/cpu_locks.sh@73 -- # killprocess 838555 00:06:16.470 17:54:25 -- common/autotest_common.sh@946 -- # '[' -z 838555 ']' 00:06:16.470 17:54:25 -- common/autotest_common.sh@950 -- # kill -0 838555 00:06:16.470 17:54:25 -- common/autotest_common.sh@951 -- # uname 00:06:16.470 17:54:25 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:16.470 17:54:25 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 838555 00:06:16.470 17:54:25 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:16.470 17:54:25 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:16.470 17:54:25 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 838555' 00:06:16.470 killing process with pid 838555 00:06:16.470 17:54:25 -- common/autotest_common.sh@965 -- # kill 838555 00:06:16.470 17:54:25 -- common/autotest_common.sh@970 -- # wait 838555 00:06:17.039 00:06:17.039 real 0m1.581s 00:06:17.039 user 0m1.595s 00:06:17.039 sys 0m0.565s 00:06:17.039 17:54:25 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:17.039 17:54:25 -- common/autotest_common.sh@10 -- # set +x 00:06:17.039 ************************************ 00:06:17.039 END TEST default_locks_via_rpc 00:06:17.039 ************************************ 00:06:17.039 17:54:26 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:17.039 17:54:26 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:17.039 17:54:26 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:17.039 17:54:26 -- common/autotest_common.sh@10 -- # set +x 00:06:17.039 ************************************ 00:06:17.039 START TEST non_locking_app_on_locked_coremask 00:06:17.039 ************************************ 00:06:17.039 17:54:26 -- common/autotest_common.sh@1121 -- # non_locking_app_on_locked_coremask 00:06:17.039 17:54:26 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=838863 00:06:17.039 17:54:26 -- event/cpu_locks.sh@81 -- # waitforlisten 838863 /var/tmp/spdk.sock 00:06:17.039 17:54:26 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:17.039 17:54:26 -- common/autotest_common.sh@827 -- # '[' -z 838863 ']' 00:06:17.039 17:54:26 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:17.039 17:54:26 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:17.039 17:54:26 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:17.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:17.039 17:54:26 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:17.039 17:54:26 -- common/autotest_common.sh@10 -- # set +x 00:06:17.039 [2024-04-26 17:54:26.200412] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:17.039 [2024-04-26 17:54:26.200466] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838863 ] 00:06:17.298 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.298 [2024-04-26 17:54:26.273053] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.298 [2024-04-26 17:54:26.361280] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.867 17:54:27 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:17.867 17:54:27 -- common/autotest_common.sh@860 -- # return 0 00:06:17.867 17:54:27 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:17.867 17:54:27 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=838960 00:06:17.867 17:54:27 -- event/cpu_locks.sh@85 -- # waitforlisten 838960 /var/tmp/spdk2.sock 00:06:17.867 17:54:27 -- common/autotest_common.sh@827 -- # '[' -z 838960 ']' 00:06:17.867 17:54:27 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:17.867 17:54:27 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:17.867 17:54:27 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:17.867 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:17.867 17:54:27 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:17.867 17:54:27 -- common/autotest_common.sh@10 -- # set +x 00:06:17.867 [2024-04-26 17:54:27.041805] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:17.867 [2024-04-26 17:54:27.041860] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid838960 ] 00:06:18.126 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.126 [2024-04-26 17:54:27.138550] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:18.126 [2024-04-26 17:54:27.138582] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:18.126 [2024-04-26 17:54:27.313609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:18.694 17:54:27 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:18.694 17:54:27 -- common/autotest_common.sh@860 -- # return 0 00:06:18.694 17:54:27 -- event/cpu_locks.sh@87 -- # locks_exist 838863 00:06:18.694 17:54:27 -- event/cpu_locks.sh@22 -- # lslocks -p 838863 00:06:18.694 17:54:27 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:20.073 lslocks: write error 00:06:20.073 17:54:28 -- event/cpu_locks.sh@89 -- # killprocess 838863 00:06:20.073 17:54:28 -- common/autotest_common.sh@946 -- # '[' -z 838863 ']' 00:06:20.073 17:54:28 -- common/autotest_common.sh@950 -- # kill -0 838863 00:06:20.073 17:54:28 -- common/autotest_common.sh@951 -- # uname 00:06:20.073 17:54:28 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:20.073 17:54:28 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 838863 00:06:20.073 17:54:29 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:20.073 17:54:29 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:20.073 17:54:29 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 838863' 00:06:20.073 killing process with pid 838863 00:06:20.073 17:54:29 -- common/autotest_common.sh@965 -- # kill 838863 00:06:20.073 17:54:29 -- common/autotest_common.sh@970 -- # wait 838863 00:06:20.640 17:54:29 -- event/cpu_locks.sh@90 -- # killprocess 838960 00:06:20.640 17:54:29 -- common/autotest_common.sh@946 -- # '[' -z 838960 ']' 00:06:20.640 17:54:29 -- common/autotest_common.sh@950 -- # kill -0 838960 00:06:20.640 17:54:29 -- common/autotest_common.sh@951 -- # uname 00:06:20.640 17:54:29 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:20.640 17:54:29 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 838960 00:06:20.640 17:54:29 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:20.640 17:54:29 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:20.640 17:54:29 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 838960' 00:06:20.640 killing process with pid 838960 00:06:20.640 17:54:29 -- common/autotest_common.sh@965 -- # kill 838960 00:06:20.640 17:54:29 -- common/autotest_common.sh@970 -- # wait 838960 00:06:21.207 00:06:21.207 real 0m4.059s 00:06:21.207 user 0m4.288s 00:06:21.207 sys 0m1.332s 00:06:21.207 17:54:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:21.207 17:54:30 -- common/autotest_common.sh@10 -- # set +x 00:06:21.207 ************************************ 00:06:21.207 END TEST non_locking_app_on_locked_coremask 00:06:21.207 ************************************ 00:06:21.207 17:54:30 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:21.207 17:54:30 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:21.207 17:54:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:21.207 17:54:30 -- common/autotest_common.sh@10 -- # set +x 00:06:21.207 ************************************ 00:06:21.207 START TEST locking_app_on_unlocked_coremask 00:06:21.207 ************************************ 00:06:21.207 17:54:30 -- common/autotest_common.sh@1121 -- # locking_app_on_unlocked_coremask 00:06:21.207 17:54:30 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=839531 00:06:21.207 17:54:30 -- event/cpu_locks.sh@99 -- # waitforlisten 839531 /var/tmp/spdk.sock 00:06:21.466 17:54:30 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:21.467 17:54:30 -- common/autotest_common.sh@827 -- # '[' -z 839531 ']' 00:06:21.467 17:54:30 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:21.467 17:54:30 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:21.467 17:54:30 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:21.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:21.467 17:54:30 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:21.467 17:54:30 -- common/autotest_common.sh@10 -- # set +x 00:06:21.467 [2024-04-26 17:54:30.449204] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:21.467 [2024-04-26 17:54:30.449257] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839531 ] 00:06:21.467 EAL: No free 2048 kB hugepages reported on node 1 00:06:21.467 [2024-04-26 17:54:30.523230] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:21.467 [2024-04-26 17:54:30.523259] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:21.467 [2024-04-26 17:54:30.610230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.404 17:54:31 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:22.404 17:54:31 -- common/autotest_common.sh@860 -- # return 0 00:06:22.404 17:54:31 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:22.404 17:54:31 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=839549 00:06:22.404 17:54:31 -- event/cpu_locks.sh@103 -- # waitforlisten 839549 /var/tmp/spdk2.sock 00:06:22.404 17:54:31 -- common/autotest_common.sh@827 -- # '[' -z 839549 ']' 00:06:22.404 17:54:31 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:22.404 17:54:31 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:22.404 17:54:31 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:22.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:22.404 17:54:31 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:22.404 17:54:31 -- common/autotest_common.sh@10 -- # set +x 00:06:22.404 [2024-04-26 17:54:31.303028] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:22.404 [2024-04-26 17:54:31.303085] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid839549 ] 00:06:22.404 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.404 [2024-04-26 17:54:31.399845] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.404 [2024-04-26 17:54:31.566537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.972 17:54:32 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:22.972 17:54:32 -- common/autotest_common.sh@860 -- # return 0 00:06:22.972 17:54:32 -- event/cpu_locks.sh@105 -- # locks_exist 839549 00:06:22.972 17:54:32 -- event/cpu_locks.sh@22 -- # lslocks -p 839549 00:06:22.972 17:54:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:24.350 lslocks: write error 00:06:24.350 17:54:33 -- event/cpu_locks.sh@107 -- # killprocess 839531 00:06:24.350 17:54:33 -- common/autotest_common.sh@946 -- # '[' -z 839531 ']' 00:06:24.350 17:54:33 -- common/autotest_common.sh@950 -- # kill -0 839531 00:06:24.350 17:54:33 -- common/autotest_common.sh@951 -- # uname 00:06:24.350 17:54:33 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:24.350 17:54:33 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 839531 00:06:24.350 17:54:33 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:24.350 17:54:33 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:24.350 17:54:33 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 839531' 00:06:24.350 killing process with pid 839531 00:06:24.350 17:54:33 -- common/autotest_common.sh@965 -- # kill 839531 00:06:24.350 17:54:33 -- common/autotest_common.sh@970 -- # wait 839531 00:06:25.289 17:54:34 -- event/cpu_locks.sh@108 -- # killprocess 839549 00:06:25.289 17:54:34 -- common/autotest_common.sh@946 -- # '[' -z 839549 ']' 00:06:25.289 17:54:34 -- common/autotest_common.sh@950 -- # kill -0 839549 00:06:25.289 17:54:34 -- common/autotest_common.sh@951 -- # uname 00:06:25.289 17:54:34 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:25.289 17:54:34 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 839549 00:06:25.289 17:54:34 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:25.289 17:54:34 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:25.289 17:54:34 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 839549' 00:06:25.289 killing process with pid 839549 00:06:25.289 17:54:34 -- common/autotest_common.sh@965 -- # kill 839549 00:06:25.289 17:54:34 -- common/autotest_common.sh@970 -- # wait 839549 00:06:25.549 00:06:25.549 real 0m4.210s 00:06:25.549 user 0m4.459s 00:06:25.549 sys 0m1.415s 00:06:25.549 17:54:34 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:25.549 17:54:34 -- common/autotest_common.sh@10 -- # set +x 00:06:25.549 ************************************ 00:06:25.549 END TEST locking_app_on_unlocked_coremask 00:06:25.549 ************************************ 00:06:25.549 17:54:34 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:25.549 17:54:34 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:25.549 17:54:34 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:25.549 17:54:34 -- common/autotest_common.sh@10 -- # set +x 00:06:25.808 ************************************ 00:06:25.808 START TEST locking_app_on_locked_coremask 00:06:25.808 ************************************ 00:06:25.808 17:54:34 -- common/autotest_common.sh@1121 -- # locking_app_on_locked_coremask 00:06:25.808 17:54:34 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=840132 00:06:25.808 17:54:34 -- event/cpu_locks.sh@116 -- # waitforlisten 840132 /var/tmp/spdk.sock 00:06:25.808 17:54:34 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:25.808 17:54:34 -- common/autotest_common.sh@827 -- # '[' -z 840132 ']' 00:06:25.808 17:54:34 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:25.808 17:54:34 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:25.808 17:54:34 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:25.808 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:25.808 17:54:34 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:25.808 17:54:34 -- common/autotest_common.sh@10 -- # set +x 00:06:25.809 [2024-04-26 17:54:34.838483] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:25.809 [2024-04-26 17:54:34.838536] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840132 ] 00:06:25.809 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.809 [2024-04-26 17:54:34.910195] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.809 [2024-04-26 17:54:34.998316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.744 17:54:35 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:26.744 17:54:35 -- common/autotest_common.sh@860 -- # return 0 00:06:26.744 17:54:35 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=840201 00:06:26.744 17:54:35 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 840201 /var/tmp/spdk2.sock 00:06:26.744 17:54:35 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:26.744 17:54:35 -- common/autotest_common.sh@648 -- # local es=0 00:06:26.744 17:54:35 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 840201 /var/tmp/spdk2.sock 00:06:26.744 17:54:35 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:06:26.744 17:54:35 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:26.744 17:54:35 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:06:26.744 17:54:35 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:26.744 17:54:35 -- common/autotest_common.sh@651 -- # waitforlisten 840201 /var/tmp/spdk2.sock 00:06:26.744 17:54:35 -- common/autotest_common.sh@827 -- # '[' -z 840201 ']' 00:06:26.744 17:54:35 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:26.744 17:54:35 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:26.744 17:54:35 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:26.744 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:26.744 17:54:35 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:26.744 17:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:26.744 [2024-04-26 17:54:35.691039] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:26.744 [2024-04-26 17:54:35.691096] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840201 ] 00:06:26.744 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.744 [2024-04-26 17:54:35.794470] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 840132 has claimed it. 00:06:26.744 [2024-04-26 17:54:35.794513] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:27.310 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (840201) - No such process 00:06:27.310 ERROR: process (pid: 840201) is no longer running 00:06:27.310 17:54:36 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:27.310 17:54:36 -- common/autotest_common.sh@860 -- # return 1 00:06:27.310 17:54:36 -- common/autotest_common.sh@651 -- # es=1 00:06:27.310 17:54:36 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:27.310 17:54:36 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:27.310 17:54:36 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:27.310 17:54:36 -- event/cpu_locks.sh@122 -- # locks_exist 840132 00:06:27.310 17:54:36 -- event/cpu_locks.sh@22 -- # lslocks -p 840132 00:06:27.310 17:54:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.569 lslocks: write error 00:06:27.569 17:54:36 -- event/cpu_locks.sh@124 -- # killprocess 840132 00:06:27.569 17:54:36 -- common/autotest_common.sh@946 -- # '[' -z 840132 ']' 00:06:27.569 17:54:36 -- common/autotest_common.sh@950 -- # kill -0 840132 00:06:27.569 17:54:36 -- common/autotest_common.sh@951 -- # uname 00:06:27.569 17:54:36 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:27.569 17:54:36 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 840132 00:06:27.569 17:54:36 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:27.569 17:54:36 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:27.569 17:54:36 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 840132' 00:06:27.569 killing process with pid 840132 00:06:27.569 17:54:36 -- common/autotest_common.sh@965 -- # kill 840132 00:06:27.569 17:54:36 -- common/autotest_common.sh@970 -- # wait 840132 00:06:28.211 00:06:28.211 real 0m2.297s 00:06:28.211 user 0m2.466s 00:06:28.211 sys 0m0.699s 00:06:28.211 17:54:37 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:28.211 17:54:37 -- common/autotest_common.sh@10 -- # set +x 00:06:28.211 ************************************ 00:06:28.211 END TEST locking_app_on_locked_coremask 00:06:28.211 ************************************ 00:06:28.211 17:54:37 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:28.211 17:54:37 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:28.211 17:54:37 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:28.211 17:54:37 -- common/autotest_common.sh@10 -- # set +x 00:06:28.211 ************************************ 00:06:28.211 START TEST locking_overlapped_coremask 00:06:28.211 ************************************ 00:06:28.211 17:54:37 -- common/autotest_common.sh@1121 -- # locking_overlapped_coremask 00:06:28.211 17:54:37 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=840533 00:06:28.211 17:54:37 -- event/cpu_locks.sh@133 -- # waitforlisten 840533 /var/tmp/spdk.sock 00:06:28.211 17:54:37 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:28.211 17:54:37 -- common/autotest_common.sh@827 -- # '[' -z 840533 ']' 00:06:28.211 17:54:37 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:28.211 17:54:37 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:28.211 17:54:37 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:28.211 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:28.211 17:54:37 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:28.211 17:54:37 -- common/autotest_common.sh@10 -- # set +x 00:06:28.211 [2024-04-26 17:54:37.318634] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:28.211 [2024-04-26 17:54:37.318689] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840533 ] 00:06:28.211 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.211 [2024-04-26 17:54:37.388691] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:28.492 [2024-04-26 17:54:37.479769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.492 [2024-04-26 17:54:37.479859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.492 [2024-04-26 17:54:37.479862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.057 17:54:38 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:29.057 17:54:38 -- common/autotest_common.sh@860 -- # return 0 00:06:29.057 17:54:38 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=840559 00:06:29.057 17:54:38 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 840559 /var/tmp/spdk2.sock 00:06:29.057 17:54:38 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:29.057 17:54:38 -- common/autotest_common.sh@648 -- # local es=0 00:06:29.057 17:54:38 -- common/autotest_common.sh@650 -- # valid_exec_arg waitforlisten 840559 /var/tmp/spdk2.sock 00:06:29.057 17:54:38 -- common/autotest_common.sh@636 -- # local arg=waitforlisten 00:06:29.057 17:54:38 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:29.057 17:54:38 -- common/autotest_common.sh@640 -- # type -t waitforlisten 00:06:29.057 17:54:38 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:29.057 17:54:38 -- common/autotest_common.sh@651 -- # waitforlisten 840559 /var/tmp/spdk2.sock 00:06:29.057 17:54:38 -- common/autotest_common.sh@827 -- # '[' -z 840559 ']' 00:06:29.057 17:54:38 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:29.057 17:54:38 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:29.057 17:54:38 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:29.057 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:29.057 17:54:38 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:29.057 17:54:38 -- common/autotest_common.sh@10 -- # set +x 00:06:29.057 [2024-04-26 17:54:38.173933] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:29.057 [2024-04-26 17:54:38.173987] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840559 ] 00:06:29.057 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.315 [2024-04-26 17:54:38.274918] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 840533 has claimed it. 00:06:29.315 [2024-04-26 17:54:38.274958] app.c: 821:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:29.884 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 842: kill: (840559) - No such process 00:06:29.884 ERROR: process (pid: 840559) is no longer running 00:06:29.884 17:54:38 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:29.884 17:54:38 -- common/autotest_common.sh@860 -- # return 1 00:06:29.884 17:54:38 -- common/autotest_common.sh@651 -- # es=1 00:06:29.884 17:54:38 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:29.884 17:54:38 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:29.884 17:54:38 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:29.884 17:54:38 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:29.884 17:54:38 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:29.884 17:54:38 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:29.884 17:54:38 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:29.884 17:54:38 -- event/cpu_locks.sh@141 -- # killprocess 840533 00:06:29.884 17:54:38 -- common/autotest_common.sh@946 -- # '[' -z 840533 ']' 00:06:29.884 17:54:38 -- common/autotest_common.sh@950 -- # kill -0 840533 00:06:29.884 17:54:38 -- common/autotest_common.sh@951 -- # uname 00:06:29.884 17:54:38 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:29.884 17:54:38 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 840533 00:06:29.884 17:54:38 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:29.884 17:54:38 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:29.884 17:54:38 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 840533' 00:06:29.884 killing process with pid 840533 00:06:29.884 17:54:38 -- common/autotest_common.sh@965 -- # kill 840533 00:06:29.884 17:54:38 -- common/autotest_common.sh@970 -- # wait 840533 00:06:30.143 00:06:30.143 real 0m1.963s 00:06:30.143 user 0m5.373s 00:06:30.143 sys 0m0.495s 00:06:30.143 17:54:39 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:30.143 17:54:39 -- common/autotest_common.sh@10 -- # set +x 00:06:30.143 ************************************ 00:06:30.143 END TEST locking_overlapped_coremask 00:06:30.144 ************************************ 00:06:30.144 17:54:39 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:30.144 17:54:39 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:30.144 17:54:39 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:30.144 17:54:39 -- common/autotest_common.sh@10 -- # set +x 00:06:30.403 ************************************ 00:06:30.403 START TEST locking_overlapped_coremask_via_rpc 00:06:30.403 ************************************ 00:06:30.403 17:54:39 -- common/autotest_common.sh@1121 -- # locking_overlapped_coremask_via_rpc 00:06:30.403 17:54:39 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=840773 00:06:30.403 17:54:39 -- event/cpu_locks.sh@149 -- # waitforlisten 840773 /var/tmp/spdk.sock 00:06:30.403 17:54:39 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:30.403 17:54:39 -- common/autotest_common.sh@827 -- # '[' -z 840773 ']' 00:06:30.403 17:54:39 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:30.403 17:54:39 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:30.403 17:54:39 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:30.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:30.403 17:54:39 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:30.403 17:54:39 -- common/autotest_common.sh@10 -- # set +x 00:06:30.403 [2024-04-26 17:54:39.474666] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:30.403 [2024-04-26 17:54:39.474723] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840773 ] 00:06:30.403 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.403 [2024-04-26 17:54:39.546103] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.403 [2024-04-26 17:54:39.546135] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:30.662 [2024-04-26 17:54:39.633479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:30.662 [2024-04-26 17:54:39.633566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:30.662 [2024-04-26 17:54:39.633568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.229 17:54:40 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:31.229 17:54:40 -- common/autotest_common.sh@860 -- # return 0 00:06:31.229 17:54:40 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=840956 00:06:31.229 17:54:40 -- event/cpu_locks.sh@153 -- # waitforlisten 840956 /var/tmp/spdk2.sock 00:06:31.229 17:54:40 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:31.229 17:54:40 -- common/autotest_common.sh@827 -- # '[' -z 840956 ']' 00:06:31.229 17:54:40 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:31.229 17:54:40 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:31.229 17:54:40 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:31.229 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:31.229 17:54:40 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:31.229 17:54:40 -- common/autotest_common.sh@10 -- # set +x 00:06:31.229 [2024-04-26 17:54:40.326705] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:31.229 [2024-04-26 17:54:40.326765] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid840956 ] 00:06:31.229 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.489 [2024-04-26 17:54:40.428127] app.c: 825:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:31.489 [2024-04-26 17:54:40.428162] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:31.489 [2024-04-26 17:54:40.588647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:31.489 [2024-04-26 17:54:40.588755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:31.489 [2024-04-26 17:54:40.588756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:32.059 17:54:41 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:32.059 17:54:41 -- common/autotest_common.sh@860 -- # return 0 00:06:32.059 17:54:41 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:32.059 17:54:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:32.059 17:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:32.059 17:54:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:32.059 17:54:41 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.059 17:54:41 -- common/autotest_common.sh@648 -- # local es=0 00:06:32.059 17:54:41 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.059 17:54:41 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:06:32.059 17:54:41 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:32.059 17:54:41 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:06:32.059 17:54:41 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:32.059 17:54:41 -- common/autotest_common.sh@651 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:32.059 17:54:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:32.059 17:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:32.059 [2024-04-26 17:54:41.140406] app.c: 690:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 840773 has claimed it. 00:06:32.059 request: 00:06:32.059 { 00:06:32.059 "method": "framework_enable_cpumask_locks", 00:06:32.059 "req_id": 1 00:06:32.059 } 00:06:32.059 Got JSON-RPC error response 00:06:32.059 response: 00:06:32.059 { 00:06:32.059 "code": -32603, 00:06:32.059 "message": "Failed to claim CPU core: 2" 00:06:32.059 } 00:06:32.059 17:54:41 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:06:32.059 17:54:41 -- common/autotest_common.sh@651 -- # es=1 00:06:32.059 17:54:41 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:32.059 17:54:41 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:32.059 17:54:41 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:32.059 17:54:41 -- event/cpu_locks.sh@158 -- # waitforlisten 840773 /var/tmp/spdk.sock 00:06:32.059 17:54:41 -- common/autotest_common.sh@827 -- # '[' -z 840773 ']' 00:06:32.059 17:54:41 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.059 17:54:41 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:32.059 17:54:41 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.059 17:54:41 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:32.059 17:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:32.318 17:54:41 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:32.318 17:54:41 -- common/autotest_common.sh@860 -- # return 0 00:06:32.318 17:54:41 -- event/cpu_locks.sh@159 -- # waitforlisten 840956 /var/tmp/spdk2.sock 00:06:32.318 17:54:41 -- common/autotest_common.sh@827 -- # '[' -z 840956 ']' 00:06:32.318 17:54:41 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:32.318 17:54:41 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:32.318 17:54:41 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:32.318 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:32.318 17:54:41 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:32.318 17:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:32.577 17:54:41 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:32.577 17:54:41 -- common/autotest_common.sh@860 -- # return 0 00:06:32.577 17:54:41 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:32.577 17:54:41 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:32.577 17:54:41 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:32.577 17:54:41 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:32.577 00:06:32.577 real 0m2.109s 00:06:32.577 user 0m0.837s 00:06:32.577 sys 0m0.209s 00:06:32.577 17:54:41 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:32.577 17:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:32.577 ************************************ 00:06:32.577 END TEST locking_overlapped_coremask_via_rpc 00:06:32.577 ************************************ 00:06:32.577 17:54:41 -- event/cpu_locks.sh@174 -- # cleanup 00:06:32.577 17:54:41 -- event/cpu_locks.sh@15 -- # [[ -z 840773 ]] 00:06:32.577 17:54:41 -- event/cpu_locks.sh@15 -- # killprocess 840773 00:06:32.577 17:54:41 -- common/autotest_common.sh@946 -- # '[' -z 840773 ']' 00:06:32.577 17:54:41 -- common/autotest_common.sh@950 -- # kill -0 840773 00:06:32.577 17:54:41 -- common/autotest_common.sh@951 -- # uname 00:06:32.577 17:54:41 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:32.577 17:54:41 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 840773 00:06:32.577 17:54:41 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:32.577 17:54:41 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:32.577 17:54:41 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 840773' 00:06:32.577 killing process with pid 840773 00:06:32.577 17:54:41 -- common/autotest_common.sh@965 -- # kill 840773 00:06:32.577 17:54:41 -- common/autotest_common.sh@970 -- # wait 840773 00:06:32.837 17:54:41 -- event/cpu_locks.sh@16 -- # [[ -z 840956 ]] 00:06:32.837 17:54:41 -- event/cpu_locks.sh@16 -- # killprocess 840956 00:06:32.837 17:54:41 -- common/autotest_common.sh@946 -- # '[' -z 840956 ']' 00:06:32.837 17:54:41 -- common/autotest_common.sh@950 -- # kill -0 840956 00:06:32.837 17:54:42 -- common/autotest_common.sh@951 -- # uname 00:06:32.837 17:54:42 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:32.837 17:54:42 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 840956 00:06:33.096 17:54:42 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:06:33.096 17:54:42 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:06:33.096 17:54:42 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 840956' 00:06:33.096 killing process with pid 840956 00:06:33.096 17:54:42 -- common/autotest_common.sh@965 -- # kill 840956 00:06:33.096 17:54:42 -- common/autotest_common.sh@970 -- # wait 840956 00:06:33.356 17:54:42 -- event/cpu_locks.sh@18 -- # rm -f 00:06:33.356 17:54:42 -- event/cpu_locks.sh@1 -- # cleanup 00:06:33.356 17:54:42 -- event/cpu_locks.sh@15 -- # [[ -z 840773 ]] 00:06:33.356 17:54:42 -- event/cpu_locks.sh@15 -- # killprocess 840773 00:06:33.356 17:54:42 -- common/autotest_common.sh@946 -- # '[' -z 840773 ']' 00:06:33.356 17:54:42 -- common/autotest_common.sh@950 -- # kill -0 840773 00:06:33.356 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 950: kill: (840773) - No such process 00:06:33.356 17:54:42 -- common/autotest_common.sh@973 -- # echo 'Process with pid 840773 is not found' 00:06:33.356 Process with pid 840773 is not found 00:06:33.356 17:54:42 -- event/cpu_locks.sh@16 -- # [[ -z 840956 ]] 00:06:33.356 17:54:42 -- event/cpu_locks.sh@16 -- # killprocess 840956 00:06:33.356 17:54:42 -- common/autotest_common.sh@946 -- # '[' -z 840956 ']' 00:06:33.356 17:54:42 -- common/autotest_common.sh@950 -- # kill -0 840956 00:06:33.356 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh: line 950: kill: (840956) - No such process 00:06:33.356 17:54:42 -- common/autotest_common.sh@973 -- # echo 'Process with pid 840956 is not found' 00:06:33.356 Process with pid 840956 is not found 00:06:33.356 17:54:42 -- event/cpu_locks.sh@18 -- # rm -f 00:06:33.356 00:06:33.356 real 0m20.467s 00:06:33.356 user 0m32.084s 00:06:33.356 sys 0m6.943s 00:06:33.356 17:54:42 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:33.356 17:54:42 -- common/autotest_common.sh@10 -- # set +x 00:06:33.356 ************************************ 00:06:33.356 END TEST cpu_locks 00:06:33.356 ************************************ 00:06:33.356 00:06:33.356 real 0m46.998s 00:06:33.356 user 1m23.694s 00:06:33.356 sys 0m11.477s 00:06:33.356 17:54:42 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:33.356 17:54:42 -- common/autotest_common.sh@10 -- # set +x 00:06:33.356 ************************************ 00:06:33.356 END TEST event 00:06:33.356 ************************************ 00:06:33.356 17:54:42 -- spdk/autotest.sh@178 -- # run_test thread /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:06:33.356 17:54:42 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:33.356 17:54:42 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:33.356 17:54:42 -- common/autotest_common.sh@10 -- # set +x 00:06:33.615 ************************************ 00:06:33.615 START TEST thread 00:06:33.615 ************************************ 00:06:33.615 17:54:42 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/thread.sh 00:06:33.615 * Looking for test storage... 00:06:33.615 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread 00:06:33.615 17:54:42 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:33.615 17:54:42 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:06:33.615 17:54:42 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:33.615 17:54:42 -- common/autotest_common.sh@10 -- # set +x 00:06:33.875 ************************************ 00:06:33.875 START TEST thread_poller_perf 00:06:33.875 ************************************ 00:06:33.875 17:54:42 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:33.875 [2024-04-26 17:54:42.968086] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:33.875 [2024-04-26 17:54:42.968150] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid841431 ] 00:06:33.875 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.875 [2024-04-26 17:54:43.041536] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.134 [2024-04-26 17:54:43.130410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.134 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:35.071 ====================================== 00:06:35.071 busy:2309686412 (cyc) 00:06:35.071 total_run_count: 415000 00:06:35.071 tsc_hz: 2300000000 (cyc) 00:06:35.071 ====================================== 00:06:35.071 poller_cost: 5565 (cyc), 2419 (nsec) 00:06:35.071 00:06:35.071 real 0m1.292s 00:06:35.071 user 0m1.192s 00:06:35.071 sys 0m0.096s 00:06:35.071 17:54:44 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:35.071 17:54:44 -- common/autotest_common.sh@10 -- # set +x 00:06:35.071 ************************************ 00:06:35.071 END TEST thread_poller_perf 00:06:35.071 ************************************ 00:06:35.330 17:54:44 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:35.330 17:54:44 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:06:35.330 17:54:44 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:35.330 17:54:44 -- common/autotest_common.sh@10 -- # set +x 00:06:35.330 ************************************ 00:06:35.330 START TEST thread_poller_perf 00:06:35.330 ************************************ 00:06:35.330 17:54:44 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:35.330 [2024-04-26 17:54:44.459993] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:35.330 [2024-04-26 17:54:44.460074] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid841641 ] 00:06:35.330 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.588 [2024-04-26 17:54:44.534245] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.588 [2024-04-26 17:54:44.622736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.588 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:36.547 ====================================== 00:06:36.547 busy:2301740042 (cyc) 00:06:36.547 total_run_count: 5428000 00:06:36.547 tsc_hz: 2300000000 (cyc) 00:06:36.547 ====================================== 00:06:36.547 poller_cost: 424 (cyc), 184 (nsec) 00:06:36.547 00:06:36.547 real 0m1.289s 00:06:36.547 user 0m1.186s 00:06:36.547 sys 0m0.097s 00:06:36.547 17:54:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:36.547 17:54:45 -- common/autotest_common.sh@10 -- # set +x 00:06:36.547 ************************************ 00:06:36.547 END TEST thread_poller_perf 00:06:36.547 ************************************ 00:06:36.806 17:54:45 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:36.806 00:06:36.806 real 0m3.068s 00:06:36.806 user 0m2.553s 00:06:36.806 sys 0m0.480s 00:06:36.806 17:54:45 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:36.806 17:54:45 -- common/autotest_common.sh@10 -- # set +x 00:06:36.806 ************************************ 00:06:36.806 END TEST thread 00:06:36.806 ************************************ 00:06:36.806 17:54:45 -- spdk/autotest.sh@179 -- # run_test accel /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:06:36.806 17:54:45 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:06:36.806 17:54:45 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:36.806 17:54:45 -- common/autotest_common.sh@10 -- # set +x 00:06:36.806 ************************************ 00:06:36.806 START TEST accel 00:06:36.806 ************************************ 00:06:36.806 17:54:45 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel.sh 00:06:37.065 * Looking for test storage... 00:06:37.065 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:06:37.065 17:54:46 -- accel/accel.sh@81 -- # declare -A expected_opcs 00:06:37.065 17:54:46 -- accel/accel.sh@82 -- # get_expected_opcs 00:06:37.065 17:54:46 -- accel/accel.sh@60 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:37.065 17:54:46 -- accel/accel.sh@62 -- # spdk_tgt_pid=841893 00:06:37.065 17:54:46 -- accel/accel.sh@63 -- # waitforlisten 841893 00:06:37.065 17:54:46 -- common/autotest_common.sh@827 -- # '[' -z 841893 ']' 00:06:37.065 17:54:46 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.065 17:54:46 -- common/autotest_common.sh@832 -- # local max_retries=100 00:06:37.065 17:54:46 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.065 17:54:46 -- common/autotest_common.sh@836 -- # xtrace_disable 00:06:37.065 17:54:46 -- common/autotest_common.sh@10 -- # set +x 00:06:37.065 17:54:46 -- accel/accel.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:37.065 17:54:46 -- accel/accel.sh@61 -- # build_accel_config 00:06:37.065 17:54:46 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:37.065 17:54:46 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:37.065 17:54:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:37.066 17:54:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:37.066 17:54:46 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:37.066 17:54:46 -- accel/accel.sh@40 -- # local IFS=, 00:06:37.066 17:54:46 -- accel/accel.sh@41 -- # jq -r . 00:06:37.066 [2024-04-26 17:54:46.124460] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:37.066 [2024-04-26 17:54:46.124513] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid841893 ] 00:06:37.066 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.066 [2024-04-26 17:54:46.194083] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.365 [2024-04-26 17:54:46.275417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.933 17:54:46 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:06:37.933 17:54:46 -- common/autotest_common.sh@860 -- # return 0 00:06:37.933 17:54:46 -- accel/accel.sh@65 -- # [[ 0 -gt 0 ]] 00:06:37.933 17:54:46 -- accel/accel.sh@66 -- # [[ 0 -gt 0 ]] 00:06:37.933 17:54:46 -- accel/accel.sh@67 -- # [[ 0 -gt 0 ]] 00:06:37.933 17:54:46 -- accel/accel.sh@68 -- # [[ -n '' ]] 00:06:37.933 17:54:46 -- accel/accel.sh@70 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:37.933 17:54:46 -- accel/accel.sh@70 -- # rpc_cmd accel_get_opc_assignments 00:06:37.933 17:54:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:06:37.933 17:54:46 -- common/autotest_common.sh@10 -- # set +x 00:06:37.933 17:54:46 -- accel/accel.sh@70 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:37.933 17:54:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@71 -- # for opc_opt in "${exp_opcs[@]}" 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # IFS== 00:06:37.933 17:54:46 -- accel/accel.sh@72 -- # read -r opc module 00:06:37.933 17:54:46 -- accel/accel.sh@73 -- # expected_opcs["$opc"]=software 00:06:37.933 17:54:46 -- accel/accel.sh@75 -- # killprocess 841893 00:06:37.933 17:54:46 -- common/autotest_common.sh@946 -- # '[' -z 841893 ']' 00:06:37.933 17:54:46 -- common/autotest_common.sh@950 -- # kill -0 841893 00:06:37.933 17:54:46 -- common/autotest_common.sh@951 -- # uname 00:06:37.933 17:54:46 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:06:37.933 17:54:46 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 841893 00:06:37.933 17:54:47 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:06:37.933 17:54:47 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:06:37.933 17:54:47 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 841893' 00:06:37.933 killing process with pid 841893 00:06:37.933 17:54:47 -- common/autotest_common.sh@965 -- # kill 841893 00:06:37.933 17:54:47 -- common/autotest_common.sh@970 -- # wait 841893 00:06:38.503 17:54:47 -- accel/accel.sh@76 -- # trap - ERR 00:06:38.503 17:54:47 -- accel/accel.sh@89 -- # run_test accel_help accel_perf -h 00:06:38.503 17:54:47 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:06:38.503 17:54:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:38.503 17:54:47 -- common/autotest_common.sh@10 -- # set +x 00:06:38.503 17:54:47 -- common/autotest_common.sh@1121 -- # accel_perf -h 00:06:38.503 17:54:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:38.503 17:54:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.503 17:54:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:38.503 17:54:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:38.503 17:54:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.503 17:54:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.503 17:54:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:38.503 17:54:47 -- accel/accel.sh@40 -- # local IFS=, 00:06:38.503 17:54:47 -- accel/accel.sh@41 -- # jq -r . 00:06:38.503 17:54:47 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:38.503 17:54:47 -- common/autotest_common.sh@10 -- # set +x 00:06:38.503 17:54:47 -- accel/accel.sh@91 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:38.503 17:54:47 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:38.503 17:54:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:38.503 17:54:47 -- common/autotest_common.sh@10 -- # set +x 00:06:38.763 ************************************ 00:06:38.763 START TEST accel_missing_filename 00:06:38.763 ************************************ 00:06:38.763 17:54:47 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w compress 00:06:38.763 17:54:47 -- common/autotest_common.sh@648 -- # local es=0 00:06:38.763 17:54:47 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:38.763 17:54:47 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:06:38.763 17:54:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:38.763 17:54:47 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:06:38.763 17:54:47 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:38.763 17:54:47 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w compress 00:06:38.763 17:54:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:38.763 17:54:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.763 17:54:47 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:38.763 17:54:47 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:38.763 17:54:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.763 17:54:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.763 17:54:47 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:38.763 17:54:47 -- accel/accel.sh@40 -- # local IFS=, 00:06:38.763 17:54:47 -- accel/accel.sh@41 -- # jq -r . 00:06:38.763 [2024-04-26 17:54:47.807814] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:38.763 [2024-04-26 17:54:47.807869] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid842130 ] 00:06:38.763 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.763 [2024-04-26 17:54:47.880515] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.022 [2024-04-26 17:54:47.963073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.022 [2024-04-26 17:54:48.011139] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:39.022 [2024-04-26 17:54:48.081387] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:06:39.022 A filename is required. 00:06:39.022 17:54:48 -- common/autotest_common.sh@651 -- # es=234 00:06:39.022 17:54:48 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:39.022 17:54:48 -- common/autotest_common.sh@660 -- # es=106 00:06:39.022 17:54:48 -- common/autotest_common.sh@661 -- # case "$es" in 00:06:39.022 17:54:48 -- common/autotest_common.sh@668 -- # es=1 00:06:39.022 17:54:48 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:39.022 00:06:39.022 real 0m0.404s 00:06:39.022 user 0m0.311s 00:06:39.022 sys 0m0.130s 00:06:39.022 17:54:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:39.022 17:54:48 -- common/autotest_common.sh@10 -- # set +x 00:06:39.022 ************************************ 00:06:39.022 END TEST accel_missing_filename 00:06:39.022 ************************************ 00:06:39.281 17:54:48 -- accel/accel.sh@93 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:39.281 17:54:48 -- common/autotest_common.sh@1097 -- # '[' 10 -le 1 ']' 00:06:39.281 17:54:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:39.281 17:54:48 -- common/autotest_common.sh@10 -- # set +x 00:06:39.281 ************************************ 00:06:39.281 START TEST accel_compress_verify 00:06:39.281 ************************************ 00:06:39.281 17:54:48 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:39.281 17:54:48 -- common/autotest_common.sh@648 -- # local es=0 00:06:39.281 17:54:48 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:39.281 17:54:48 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:06:39.281 17:54:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:39.281 17:54:48 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:06:39.281 17:54:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:39.281 17:54:48 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:39.281 17:54:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:06:39.281 17:54:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.281 17:54:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:39.281 17:54:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:39.281 17:54:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.281 17:54:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.281 17:54:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:39.281 17:54:48 -- accel/accel.sh@40 -- # local IFS=, 00:06:39.281 17:54:48 -- accel/accel.sh@41 -- # jq -r . 00:06:39.281 [2024-04-26 17:54:48.382802] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:39.281 [2024-04-26 17:54:48.382859] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid842327 ] 00:06:39.281 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.281 [2024-04-26 17:54:48.453865] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.542 [2024-04-26 17:54:48.535815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.542 [2024-04-26 17:54:48.583613] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:39.542 [2024-04-26 17:54:48.653459] accel_perf.c:1394:main: *ERROR*: ERROR starting application 00:06:39.802 00:06:39.802 Compression does not support the verify option, aborting. 00:06:39.802 17:54:48 -- common/autotest_common.sh@651 -- # es=161 00:06:39.802 17:54:48 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:39.802 17:54:48 -- common/autotest_common.sh@660 -- # es=33 00:06:39.802 17:54:48 -- common/autotest_common.sh@661 -- # case "$es" in 00:06:39.802 17:54:48 -- common/autotest_common.sh@668 -- # es=1 00:06:39.802 17:54:48 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:39.802 00:06:39.802 real 0m0.401s 00:06:39.802 user 0m0.301s 00:06:39.802 sys 0m0.140s 00:06:39.802 17:54:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:39.802 17:54:48 -- common/autotest_common.sh@10 -- # set +x 00:06:39.802 ************************************ 00:06:39.802 END TEST accel_compress_verify 00:06:39.802 ************************************ 00:06:39.802 17:54:48 -- accel/accel.sh@95 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:39.802 17:54:48 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:39.802 17:54:48 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:39.802 17:54:48 -- common/autotest_common.sh@10 -- # set +x 00:06:39.802 ************************************ 00:06:39.802 START TEST accel_wrong_workload 00:06:39.802 ************************************ 00:06:39.802 17:54:48 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w foobar 00:06:39.802 17:54:48 -- common/autotest_common.sh@648 -- # local es=0 00:06:39.802 17:54:48 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:39.802 17:54:48 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:06:39.802 17:54:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:39.802 17:54:48 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:06:39.802 17:54:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:39.802 17:54:48 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w foobar 00:06:39.802 17:54:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:39.802 17:54:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.802 17:54:48 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:39.802 17:54:48 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:39.802 17:54:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.802 17:54:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.802 17:54:48 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:39.802 17:54:48 -- accel/accel.sh@40 -- # local IFS=, 00:06:39.802 17:54:48 -- accel/accel.sh@41 -- # jq -r . 00:06:39.802 Unsupported workload type: foobar 00:06:39.802 [2024-04-26 17:54:48.966280] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:39.802 accel_perf options: 00:06:39.802 [-h help message] 00:06:39.802 [-q queue depth per core] 00:06:39.802 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:39.802 [-T number of threads per core 00:06:39.802 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:39.802 [-t time in seconds] 00:06:39.802 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:39.802 [ dif_verify, , dif_generate, dif_generate_copy 00:06:39.802 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:39.802 [-l for compress/decompress workloads, name of uncompressed input file 00:06:39.802 [-S for crc32c workload, use this seed value (default 0) 00:06:39.802 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:39.802 [-f for fill workload, use this BYTE value (default 255) 00:06:39.802 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:39.802 [-y verify result if this switch is on] 00:06:39.802 [-a tasks to allocate per core (default: same value as -q)] 00:06:39.802 Can be used to spread operations across a wider range of memory. 00:06:39.802 17:54:48 -- common/autotest_common.sh@651 -- # es=1 00:06:39.802 17:54:48 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:39.802 17:54:48 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:39.802 17:54:48 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:39.802 00:06:39.802 real 0m0.033s 00:06:39.802 user 0m0.016s 00:06:39.802 sys 0m0.016s 00:06:39.802 17:54:48 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:39.802 17:54:48 -- common/autotest_common.sh@10 -- # set +x 00:06:39.802 ************************************ 00:06:39.802 END TEST accel_wrong_workload 00:06:39.802 ************************************ 00:06:39.802 Error: writing output failed: Broken pipe 00:06:40.063 17:54:49 -- accel/accel.sh@97 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:40.063 17:54:49 -- common/autotest_common.sh@1097 -- # '[' 10 -le 1 ']' 00:06:40.063 17:54:49 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:40.063 17:54:49 -- common/autotest_common.sh@10 -- # set +x 00:06:40.063 ************************************ 00:06:40.063 START TEST accel_negative_buffers 00:06:40.063 ************************************ 00:06:40.063 17:54:49 -- common/autotest_common.sh@1121 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:40.063 17:54:49 -- common/autotest_common.sh@648 -- # local es=0 00:06:40.063 17:54:49 -- common/autotest_common.sh@650 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:40.063 17:54:49 -- common/autotest_common.sh@636 -- # local arg=accel_perf 00:06:40.063 17:54:49 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:40.063 17:54:49 -- common/autotest_common.sh@640 -- # type -t accel_perf 00:06:40.063 17:54:49 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:06:40.063 17:54:49 -- common/autotest_common.sh@651 -- # accel_perf -t 1 -w xor -y -x -1 00:06:40.063 17:54:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:40.063 17:54:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.063 17:54:49 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:40.063 17:54:49 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:40.063 17:54:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.063 17:54:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.063 17:54:49 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:40.063 17:54:49 -- accel/accel.sh@40 -- # local IFS=, 00:06:40.063 17:54:49 -- accel/accel.sh@41 -- # jq -r . 00:06:40.063 -x option must be non-negative. 00:06:40.063 [2024-04-26 17:54:49.172572] app.c:1364:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:40.063 accel_perf options: 00:06:40.063 [-h help message] 00:06:40.063 [-q queue depth per core] 00:06:40.063 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:40.063 [-T number of threads per core 00:06:40.063 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:40.063 [-t time in seconds] 00:06:40.063 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:40.063 [ dif_verify, , dif_generate, dif_generate_copy 00:06:40.063 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:40.063 [-l for compress/decompress workloads, name of uncompressed input file 00:06:40.063 [-S for crc32c workload, use this seed value (default 0) 00:06:40.063 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:40.063 [-f for fill workload, use this BYTE value (default 255) 00:06:40.063 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:40.063 [-y verify result if this switch is on] 00:06:40.063 [-a tasks to allocate per core (default: same value as -q)] 00:06:40.063 Can be used to spread operations across a wider range of memory. 00:06:40.063 17:54:49 -- common/autotest_common.sh@651 -- # es=1 00:06:40.063 17:54:49 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:06:40.063 17:54:49 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:06:40.063 17:54:49 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:06:40.063 00:06:40.063 real 0m0.033s 00:06:40.063 user 0m0.020s 00:06:40.063 sys 0m0.014s 00:06:40.063 17:54:49 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:40.063 17:54:49 -- common/autotest_common.sh@10 -- # set +x 00:06:40.063 ************************************ 00:06:40.063 END TEST accel_negative_buffers 00:06:40.063 ************************************ 00:06:40.063 Error: writing output failed: Broken pipe 00:06:40.063 17:54:49 -- accel/accel.sh@101 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:40.063 17:54:49 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:40.063 17:54:49 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:40.063 17:54:49 -- common/autotest_common.sh@10 -- # set +x 00:06:40.322 ************************************ 00:06:40.322 START TEST accel_crc32c 00:06:40.322 ************************************ 00:06:40.322 17:54:49 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:40.322 17:54:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:40.322 17:54:49 -- accel/accel.sh@17 -- # local accel_module 00:06:40.322 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.322 17:54:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:40.322 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.322 17:54:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:40.322 17:54:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:40.322 17:54:49 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:40.323 17:54:49 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:40.323 17:54:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:40.323 17:54:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:40.323 17:54:49 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:40.323 17:54:49 -- accel/accel.sh@40 -- # local IFS=, 00:06:40.323 17:54:49 -- accel/accel.sh@41 -- # jq -r . 00:06:40.323 [2024-04-26 17:54:49.400649] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:40.323 [2024-04-26 17:54:49.400709] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid842477 ] 00:06:40.323 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.323 [2024-04-26 17:54:49.475036] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:40.582 [2024-04-26 17:54:49.561206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=0x1 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=crc32c 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=32 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=software 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@22 -- # accel_module=software 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=32 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=32 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=1 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val=Yes 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:40.582 17:54:49 -- accel/accel.sh@20 -- # val= 00:06:40.582 17:54:49 -- accel/accel.sh@21 -- # case "$var" in 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # IFS=: 00:06:40.582 17:54:49 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@20 -- # val= 00:06:41.961 17:54:50 -- accel/accel.sh@21 -- # case "$var" in 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:41.961 17:54:50 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:06:41.961 17:54:50 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:41.961 00:06:41.961 real 0m1.414s 00:06:41.961 user 0m1.265s 00:06:41.961 sys 0m0.154s 00:06:41.961 17:54:50 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:41.961 17:54:50 -- common/autotest_common.sh@10 -- # set +x 00:06:41.961 ************************************ 00:06:41.961 END TEST accel_crc32c 00:06:41.961 ************************************ 00:06:41.961 17:54:50 -- accel/accel.sh@102 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:41.961 17:54:50 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:41.961 17:54:50 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:41.961 17:54:50 -- common/autotest_common.sh@10 -- # set +x 00:06:41.961 ************************************ 00:06:41.961 START TEST accel_crc32c_C2 00:06:41.961 ************************************ 00:06:41.961 17:54:50 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:41.961 17:54:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:41.961 17:54:50 -- accel/accel.sh@17 -- # local accel_module 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # IFS=: 00:06:41.961 17:54:50 -- accel/accel.sh@19 -- # read -r var val 00:06:41.961 17:54:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:41.961 17:54:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:41.961 17:54:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.961 17:54:50 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:41.961 17:54:50 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:41.961 17:54:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.961 17:54:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.961 17:54:50 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:41.961 17:54:50 -- accel/accel.sh@40 -- # local IFS=, 00:06:41.961 17:54:50 -- accel/accel.sh@41 -- # jq -r . 00:06:41.961 [2024-04-26 17:54:50.990398] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:41.961 [2024-04-26 17:54:50.990459] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid842793 ] 00:06:41.961 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.961 [2024-04-26 17:54:51.062243] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.961 [2024-04-26 17:54:51.142811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=0x1 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=crc32c 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@23 -- # accel_opc=crc32c 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=0 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=software 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@22 -- # accel_module=software 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=32 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=32 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=1 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val=Yes 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:42.220 17:54:51 -- accel/accel.sh@20 -- # val= 00:06:42.220 17:54:51 -- accel/accel.sh@21 -- # case "$var" in 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # IFS=: 00:06:42.220 17:54:51 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:43.599 17:54:52 -- accel/accel.sh@27 -- # [[ -n crc32c ]] 00:06:43.599 17:54:52 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:43.599 00:06:43.599 real 0m1.409s 00:06:43.599 user 0m1.280s 00:06:43.599 sys 0m0.143s 00:06:43.599 17:54:52 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:43.599 17:54:52 -- common/autotest_common.sh@10 -- # set +x 00:06:43.599 ************************************ 00:06:43.599 END TEST accel_crc32c_C2 00:06:43.599 ************************************ 00:06:43.599 17:54:52 -- accel/accel.sh@103 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:43.599 17:54:52 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:43.599 17:54:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:43.599 17:54:52 -- common/autotest_common.sh@10 -- # set +x 00:06:43.599 ************************************ 00:06:43.599 START TEST accel_copy 00:06:43.599 ************************************ 00:06:43.599 17:54:52 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy -y 00:06:43.599 17:54:52 -- accel/accel.sh@16 -- # local accel_opc 00:06:43.599 17:54:52 -- accel/accel.sh@17 -- # local accel_module 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:43.599 17:54:52 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.599 17:54:52 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:43.599 17:54:52 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:43.599 17:54:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.599 17:54:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.599 17:54:52 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:43.599 17:54:52 -- accel/accel.sh@40 -- # local IFS=, 00:06:43.599 17:54:52 -- accel/accel.sh@41 -- # jq -r . 00:06:43.599 [2024-04-26 17:54:52.550087] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:43.599 [2024-04-26 17:54:52.550135] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843002 ] 00:06:43.599 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.599 [2024-04-26 17:54:52.621421] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.599 [2024-04-26 17:54:52.700434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.599 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.599 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.599 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=0x1 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=copy 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@23 -- # accel_opc=copy 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=software 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@22 -- # accel_module=software 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=32 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=32 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=1 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val=Yes 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:43.600 17:54:52 -- accel/accel.sh@20 -- # val= 00:06:43.600 17:54:52 -- accel/accel.sh@21 -- # case "$var" in 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # IFS=: 00:06:43.600 17:54:52 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@20 -- # val= 00:06:44.980 17:54:53 -- accel/accel.sh@21 -- # case "$var" in 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:53 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:53 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:44.980 17:54:53 -- accel/accel.sh@27 -- # [[ -n copy ]] 00:06:44.980 17:54:53 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:44.980 00:06:44.980 real 0m1.392s 00:06:44.980 user 0m1.279s 00:06:44.980 sys 0m0.125s 00:06:44.980 17:54:53 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:44.980 17:54:53 -- common/autotest_common.sh@10 -- # set +x 00:06:44.980 ************************************ 00:06:44.980 END TEST accel_copy 00:06:44.980 ************************************ 00:06:44.980 17:54:53 -- accel/accel.sh@104 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.980 17:54:53 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:06:44.980 17:54:53 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:44.980 17:54:53 -- common/autotest_common.sh@10 -- # set +x 00:06:44.980 ************************************ 00:06:44.980 START TEST accel_fill 00:06:44.980 ************************************ 00:06:44.980 17:54:54 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.980 17:54:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:44.980 17:54:54 -- accel/accel.sh@17 -- # local accel_module 00:06:44.980 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:44.980 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:44.980 17:54:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.980 17:54:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:44.980 17:54:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:44.980 17:54:54 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:44.980 17:54:54 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:44.980 17:54:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:44.980 17:54:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:44.980 17:54:54 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:44.980 17:54:54 -- accel/accel.sh@40 -- # local IFS=, 00:06:44.980 17:54:54 -- accel/accel.sh@41 -- # jq -r . 00:06:44.980 [2024-04-26 17:54:54.123250] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:44.980 [2024-04-26 17:54:54.123309] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843220 ] 00:06:44.980 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.239 [2024-04-26 17:54:54.194935] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.239 [2024-04-26 17:54:54.277034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val=0x1 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.239 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.239 17:54:54 -- accel/accel.sh@20 -- # val=fill 00:06:45.239 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@23 -- # accel_opc=fill 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=0x80 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=software 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@22 -- # accel_module=software 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=64 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=64 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=1 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val=Yes 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:45.240 17:54:54 -- accel/accel.sh@20 -- # val= 00:06:45.240 17:54:54 -- accel/accel.sh@21 -- # case "$var" in 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # IFS=: 00:06:45.240 17:54:54 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.618 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:46.618 17:54:55 -- accel/accel.sh@27 -- # [[ -n fill ]] 00:06:46.618 17:54:55 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:46.618 00:06:46.618 real 0m1.407s 00:06:46.618 user 0m1.268s 00:06:46.618 sys 0m0.144s 00:06:46.618 17:54:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:46.618 17:54:55 -- common/autotest_common.sh@10 -- # set +x 00:06:46.618 ************************************ 00:06:46.618 END TEST accel_fill 00:06:46.618 ************************************ 00:06:46.618 17:54:55 -- accel/accel.sh@105 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:46.618 17:54:55 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:46.618 17:54:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:46.618 17:54:55 -- common/autotest_common.sh@10 -- # set +x 00:06:46.618 ************************************ 00:06:46.618 START TEST accel_copy_crc32c 00:06:46.618 ************************************ 00:06:46.618 17:54:55 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy_crc32c -y 00:06:46.618 17:54:55 -- accel/accel.sh@16 -- # local accel_opc 00:06:46.618 17:54:55 -- accel/accel.sh@17 -- # local accel_module 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.618 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.618 17:54:55 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:46.618 17:54:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:46.618 17:54:55 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.618 17:54:55 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:46.618 17:54:55 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:46.618 17:54:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.618 17:54:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.618 17:54:55 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:46.618 17:54:55 -- accel/accel.sh@40 -- # local IFS=, 00:06:46.618 17:54:55 -- accel/accel.sh@41 -- # jq -r . 00:06:46.618 [2024-04-26 17:54:55.715088] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:46.618 [2024-04-26 17:54:55.715179] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843424 ] 00:06:46.618 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.618 [2024-04-26 17:54:55.787421] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.933 [2024-04-26 17:54:55.872953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=0x1 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=copy_crc32c 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=0 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=software 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@22 -- # accel_module=software 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=32 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=32 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=1 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val=Yes 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:46.933 17:54:55 -- accel/accel.sh@20 -- # val= 00:06:46.933 17:54:55 -- accel/accel.sh@21 -- # case "$var" in 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # IFS=: 00:06:46.933 17:54:55 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:47.917 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:47.917 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:47.917 17:54:57 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:47.917 17:54:57 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:47.917 17:54:57 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:47.917 00:06:47.917 real 0m1.409s 00:06:47.917 user 0m1.271s 00:06:47.917 sys 0m0.142s 00:06:47.917 17:54:57 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:47.917 17:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:47.917 ************************************ 00:06:47.917 END TEST accel_copy_crc32c 00:06:47.917 ************************************ 00:06:48.177 17:54:57 -- accel/accel.sh@106 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:48.177 17:54:57 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:48.177 17:54:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:48.177 17:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:48.177 ************************************ 00:06:48.177 START TEST accel_copy_crc32c_C2 00:06:48.177 ************************************ 00:06:48.177 17:54:57 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:48.177 17:54:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:48.177 17:54:57 -- accel/accel.sh@17 -- # local accel_module 00:06:48.177 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.177 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.177 17:54:57 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:48.177 17:54:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:48.177 17:54:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.177 17:54:57 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:48.177 17:54:57 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:48.177 17:54:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.177 17:54:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.177 17:54:57 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:48.177 17:54:57 -- accel/accel.sh@40 -- # local IFS=, 00:06:48.177 17:54:57 -- accel/accel.sh@41 -- # jq -r . 00:06:48.177 [2024-04-26 17:54:57.281194] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:48.177 [2024-04-26 17:54:57.281252] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843642 ] 00:06:48.177 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.177 [2024-04-26 17:54:57.352702] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.436 [2024-04-26 17:54:57.439176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=0x1 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=copy_crc32c 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@23 -- # accel_opc=copy_crc32c 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=0 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val='8192 bytes' 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=software 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@22 -- # accel_module=software 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=32 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=32 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=1 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val=Yes 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:48.436 17:54:57 -- accel/accel.sh@20 -- # val= 00:06:48.436 17:54:57 -- accel/accel.sh@21 -- # case "$var" in 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # IFS=: 00:06:48.436 17:54:57 -- accel/accel.sh@19 -- # read -r var val 00:06:49.813 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@20 -- # val= 00:06:49.814 17:54:58 -- accel/accel.sh@21 -- # case "$var" in 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:49.814 17:54:58 -- accel/accel.sh@27 -- # [[ -n copy_crc32c ]] 00:06:49.814 17:54:58 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:49.814 00:06:49.814 real 0m1.411s 00:06:49.814 user 0m1.278s 00:06:49.814 sys 0m0.139s 00:06:49.814 17:54:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:49.814 17:54:58 -- common/autotest_common.sh@10 -- # set +x 00:06:49.814 ************************************ 00:06:49.814 END TEST accel_copy_crc32c_C2 00:06:49.814 ************************************ 00:06:49.814 17:54:58 -- accel/accel.sh@107 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:49.814 17:54:58 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:49.814 17:54:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:49.814 17:54:58 -- common/autotest_common.sh@10 -- # set +x 00:06:49.814 ************************************ 00:06:49.814 START TEST accel_dualcast 00:06:49.814 ************************************ 00:06:49.814 17:54:58 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dualcast -y 00:06:49.814 17:54:58 -- accel/accel.sh@16 -- # local accel_opc 00:06:49.814 17:54:58 -- accel/accel.sh@17 -- # local accel_module 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # IFS=: 00:06:49.814 17:54:58 -- accel/accel.sh@19 -- # read -r var val 00:06:49.814 17:54:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:49.814 17:54:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:49.814 17:54:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.814 17:54:58 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:49.814 17:54:58 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:49.814 17:54:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.814 17:54:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.814 17:54:58 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:49.814 17:54:58 -- accel/accel.sh@40 -- # local IFS=, 00:06:49.814 17:54:58 -- accel/accel.sh@41 -- # jq -r . 00:06:49.814 [2024-04-26 17:54:58.880097] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:49.814 [2024-04-26 17:54:58.880162] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843887 ] 00:06:49.814 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.814 [2024-04-26 17:54:58.951806] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.073 [2024-04-26 17:54:59.036946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=0x1 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=dualcast 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@23 -- # accel_opc=dualcast 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=software 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@22 -- # accel_module=software 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=32 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=32 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=1 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val=Yes 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.073 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.073 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.073 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.074 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:50.074 17:54:59 -- accel/accel.sh@20 -- # val= 00:06:50.074 17:54:59 -- accel/accel.sh@21 -- # case "$var" in 00:06:50.074 17:54:59 -- accel/accel.sh@19 -- # IFS=: 00:06:50.074 17:54:59 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.450 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:51.450 17:55:00 -- accel/accel.sh@27 -- # [[ -n dualcast ]] 00:06:51.450 17:55:00 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:51.450 00:06:51.450 real 0m1.403s 00:06:51.450 user 0m1.273s 00:06:51.450 sys 0m0.134s 00:06:51.450 17:55:00 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:51.450 17:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:51.450 ************************************ 00:06:51.450 END TEST accel_dualcast 00:06:51.450 ************************************ 00:06:51.450 17:55:00 -- accel/accel.sh@108 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:51.450 17:55:00 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:51.450 17:55:00 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:51.450 17:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:51.450 ************************************ 00:06:51.450 START TEST accel_compare 00:06:51.450 ************************************ 00:06:51.450 17:55:00 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w compare -y 00:06:51.450 17:55:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:51.450 17:55:00 -- accel/accel.sh@17 -- # local accel_module 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.450 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.450 17:55:00 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:51.450 17:55:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:51.450 17:55:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:51.450 17:55:00 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:51.450 17:55:00 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:51.450 17:55:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:51.450 17:55:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:51.450 17:55:00 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:51.450 17:55:00 -- accel/accel.sh@40 -- # local IFS=, 00:06:51.450 17:55:00 -- accel/accel.sh@41 -- # jq -r . 00:06:51.450 [2024-04-26 17:55:00.485499] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:51.450 [2024-04-26 17:55:00.485556] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844215 ] 00:06:51.450 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.450 [2024-04-26 17:55:00.559306] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.709 [2024-04-26 17:55:00.643716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=0x1 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=compare 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@23 -- # accel_opc=compare 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=software 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@22 -- # accel_module=software 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=32 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=32 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=1 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val=Yes 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:51.709 17:55:00 -- accel/accel.sh@20 -- # val= 00:06:51.709 17:55:00 -- accel/accel.sh@21 -- # case "$var" in 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # IFS=: 00:06:51.709 17:55:00 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@20 -- # val= 00:06:53.085 17:55:01 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:01 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:01 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:53.085 17:55:01 -- accel/accel.sh@27 -- # [[ -n compare ]] 00:06:53.085 17:55:01 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.085 00:06:53.085 real 0m1.416s 00:06:53.085 user 0m1.280s 00:06:53.085 sys 0m0.139s 00:06:53.085 17:55:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:53.085 17:55:01 -- common/autotest_common.sh@10 -- # set +x 00:06:53.085 ************************************ 00:06:53.085 END TEST accel_compare 00:06:53.085 ************************************ 00:06:53.085 17:55:01 -- accel/accel.sh@109 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:53.085 17:55:01 -- common/autotest_common.sh@1097 -- # '[' 7 -le 1 ']' 00:06:53.085 17:55:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:53.085 17:55:01 -- common/autotest_common.sh@10 -- # set +x 00:06:53.085 ************************************ 00:06:53.085 START TEST accel_xor 00:06:53.085 ************************************ 00:06:53.085 17:55:02 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w xor -y 00:06:53.085 17:55:02 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.085 17:55:02 -- accel/accel.sh@17 -- # local accel_module 00:06:53.085 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.085 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.085 17:55:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:53.085 17:55:02 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.085 17:55:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:53.085 17:55:02 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:53.085 17:55:02 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:53.085 17:55:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.085 17:55:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.085 17:55:02 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:53.085 17:55:02 -- accel/accel.sh@40 -- # local IFS=, 00:06:53.085 17:55:02 -- accel/accel.sh@41 -- # jq -r . 00:06:53.085 [2024-04-26 17:55:02.090676] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:53.085 [2024-04-26 17:55:02.090737] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844432 ] 00:06:53.085 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.085 [2024-04-26 17:55:02.161544] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.085 [2024-04-26 17:55:02.244678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=0x1 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=xor 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=2 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=software 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@22 -- # accel_module=software 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=32 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=32 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=1 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val=Yes 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:53.345 17:55:02 -- accel/accel.sh@20 -- # val= 00:06:53.345 17:55:02 -- accel/accel.sh@21 -- # case "$var" in 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # IFS=: 00:06:53.345 17:55:02 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.282 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.282 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.282 17:55:03 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:54.282 17:55:03 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:54.282 17:55:03 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:54.282 00:06:54.282 real 0m1.406s 00:06:54.282 user 0m1.269s 00:06:54.282 sys 0m0.141s 00:06:54.282 17:55:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:54.282 17:55:03 -- common/autotest_common.sh@10 -- # set +x 00:06:54.282 ************************************ 00:06:54.282 END TEST accel_xor 00:06:54.282 ************************************ 00:06:54.542 17:55:03 -- accel/accel.sh@110 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:54.542 17:55:03 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:06:54.542 17:55:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:54.542 17:55:03 -- common/autotest_common.sh@10 -- # set +x 00:06:54.542 ************************************ 00:06:54.542 START TEST accel_xor 00:06:54.542 ************************************ 00:06:54.542 17:55:03 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w xor -y -x 3 00:06:54.542 17:55:03 -- accel/accel.sh@16 -- # local accel_opc 00:06:54.542 17:55:03 -- accel/accel.sh@17 -- # local accel_module 00:06:54.542 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.542 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.542 17:55:03 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:54.542 17:55:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:54.542 17:55:03 -- accel/accel.sh@12 -- # build_accel_config 00:06:54.542 17:55:03 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:54.542 17:55:03 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:54.542 17:55:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.542 17:55:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.542 17:55:03 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:54.542 17:55:03 -- accel/accel.sh@40 -- # local IFS=, 00:06:54.542 17:55:03 -- accel/accel.sh@41 -- # jq -r . 00:06:54.542 [2024-04-26 17:55:03.696708] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:54.542 [2024-04-26 17:55:03.696765] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844649 ] 00:06:54.542 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.801 [2024-04-26 17:55:03.770577] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.801 [2024-04-26 17:55:03.855093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=0x1 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=xor 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@23 -- # accel_opc=xor 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=3 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=software 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@22 -- # accel_module=software 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=32 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=32 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=1 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val=Yes 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:54.801 17:55:03 -- accel/accel.sh@20 -- # val= 00:06:54.801 17:55:03 -- accel/accel.sh@21 -- # case "$var" in 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # IFS=: 00:06:54.801 17:55:03 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.179 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:56.179 17:55:05 -- accel/accel.sh@27 -- # [[ -n xor ]] 00:06:56.179 17:55:05 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.179 00:06:56.179 real 0m1.397s 00:06:56.179 user 0m1.258s 00:06:56.179 sys 0m0.143s 00:06:56.179 17:55:05 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:56.179 17:55:05 -- common/autotest_common.sh@10 -- # set +x 00:06:56.179 ************************************ 00:06:56.179 END TEST accel_xor 00:06:56.179 ************************************ 00:06:56.179 17:55:05 -- accel/accel.sh@111 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:56.179 17:55:05 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:56.179 17:55:05 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:56.179 17:55:05 -- common/autotest_common.sh@10 -- # set +x 00:06:56.179 ************************************ 00:06:56.179 START TEST accel_dif_verify 00:06:56.179 ************************************ 00:06:56.179 17:55:05 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_verify 00:06:56.179 17:55:05 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.179 17:55:05 -- accel/accel.sh@17 -- # local accel_module 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.179 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.179 17:55:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:56.179 17:55:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:56.179 17:55:05 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.179 17:55:05 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:56.179 17:55:05 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:56.179 17:55:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.179 17:55:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.179 17:55:05 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:56.179 17:55:05 -- accel/accel.sh@40 -- # local IFS=, 00:06:56.179 17:55:05 -- accel/accel.sh@41 -- # jq -r . 00:06:56.179 [2024-04-26 17:55:05.281453] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:56.180 [2024-04-26 17:55:05.281513] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid844861 ] 00:06:56.180 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.180 [2024-04-26 17:55:05.355886] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.438 [2024-04-26 17:55:05.444671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=0x1 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=dif_verify 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@23 -- # accel_opc=dif_verify 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=software 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@22 -- # accel_module=software 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=32 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=32 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=1 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val=No 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:56.438 17:55:05 -- accel/accel.sh@20 -- # val= 00:06:56.438 17:55:05 -- accel/accel.sh@21 -- # case "$var" in 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # IFS=: 00:06:56.438 17:55:05 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@20 -- # val= 00:06:57.814 17:55:06 -- accel/accel.sh@21 -- # case "$var" in 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:57.814 17:55:06 -- accel/accel.sh@27 -- # [[ -n dif_verify ]] 00:06:57.814 17:55:06 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:57.814 00:06:57.814 real 0m1.419s 00:06:57.814 user 0m1.272s 00:06:57.814 sys 0m0.152s 00:06:57.814 17:55:06 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:57.814 17:55:06 -- common/autotest_common.sh@10 -- # set +x 00:06:57.814 ************************************ 00:06:57.814 END TEST accel_dif_verify 00:06:57.814 ************************************ 00:06:57.814 17:55:06 -- accel/accel.sh@112 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:57.814 17:55:06 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:57.814 17:55:06 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:57.814 17:55:06 -- common/autotest_common.sh@10 -- # set +x 00:06:57.814 ************************************ 00:06:57.814 START TEST accel_dif_generate 00:06:57.814 ************************************ 00:06:57.814 17:55:06 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_generate 00:06:57.814 17:55:06 -- accel/accel.sh@16 -- # local accel_opc 00:06:57.814 17:55:06 -- accel/accel.sh@17 -- # local accel_module 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # IFS=: 00:06:57.814 17:55:06 -- accel/accel.sh@19 -- # read -r var val 00:06:57.814 17:55:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:57.814 17:55:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:57.814 17:55:06 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.814 17:55:06 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:57.814 17:55:06 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:57.814 17:55:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.814 17:55:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.814 17:55:06 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:57.814 17:55:06 -- accel/accel.sh@40 -- # local IFS=, 00:06:57.814 17:55:06 -- accel/accel.sh@41 -- # jq -r . 00:06:57.814 [2024-04-26 17:55:06.897097] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:57.814 [2024-04-26 17:55:06.897158] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845068 ] 00:06:57.814 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.814 [2024-04-26 17:55:06.970239] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.074 [2024-04-26 17:55:07.056933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=0x1 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=dif_generate 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@23 -- # accel_opc=dif_generate 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val='512 bytes' 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val='8 bytes' 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=software 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@22 -- # accel_module=software 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=32 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=32 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=1 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val=No 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:58.074 17:55:07 -- accel/accel.sh@20 -- # val= 00:06:58.074 17:55:07 -- accel/accel.sh@21 -- # case "$var" in 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # IFS=: 00:06:58.074 17:55:07 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.451 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.451 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.451 17:55:08 -- accel/accel.sh@27 -- # [[ -n software ]] 00:06:59.451 17:55:08 -- accel/accel.sh@27 -- # [[ -n dif_generate ]] 00:06:59.451 17:55:08 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.451 00:06:59.451 real 0m1.414s 00:06:59.451 user 0m1.277s 00:06:59.451 sys 0m0.143s 00:06:59.451 17:55:08 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:06:59.451 17:55:08 -- common/autotest_common.sh@10 -- # set +x 00:06:59.451 ************************************ 00:06:59.452 END TEST accel_dif_generate 00:06:59.452 ************************************ 00:06:59.452 17:55:08 -- accel/accel.sh@113 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:59.452 17:55:08 -- common/autotest_common.sh@1097 -- # '[' 6 -le 1 ']' 00:06:59.452 17:55:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:06:59.452 17:55:08 -- common/autotest_common.sh@10 -- # set +x 00:06:59.452 ************************************ 00:06:59.452 START TEST accel_dif_generate_copy 00:06:59.452 ************************************ 00:06:59.452 17:55:08 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w dif_generate_copy 00:06:59.452 17:55:08 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.452 17:55:08 -- accel/accel.sh@17 -- # local accel_module 00:06:59.452 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.452 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.452 17:55:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:59.452 17:55:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:59.452 17:55:08 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.452 17:55:08 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:06:59.452 17:55:08 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:06:59.452 17:55:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.452 17:55:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.452 17:55:08 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:06:59.452 17:55:08 -- accel/accel.sh@40 -- # local IFS=, 00:06:59.452 17:55:08 -- accel/accel.sh@41 -- # jq -r . 00:06:59.452 [2024-04-26 17:55:08.492684] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:06:59.452 [2024-04-26 17:55:08.492732] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845309 ] 00:06:59.452 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.452 [2024-04-26 17:55:08.558217] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.452 [2024-04-26 17:55:08.642964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=0x1 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=dif_generate_copy 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@23 -- # accel_opc=dif_generate_copy 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val='4096 bytes' 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=software 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@22 -- # accel_module=software 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=32 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=32 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=1 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val='1 seconds' 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val=No 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:06:59.711 17:55:08 -- accel/accel.sh@20 -- # val= 00:06:59.711 17:55:08 -- accel/accel.sh@21 -- # case "$var" in 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # IFS=: 00:06:59.711 17:55:08 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@20 -- # val= 00:07:01.089 17:55:09 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:09 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:09 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:01.089 17:55:09 -- accel/accel.sh@27 -- # [[ -n dif_generate_copy ]] 00:07:01.089 17:55:09 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.089 00:07:01.089 real 0m1.392s 00:07:01.089 user 0m1.271s 00:07:01.089 sys 0m0.125s 00:07:01.089 17:55:09 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:01.089 17:55:09 -- common/autotest_common.sh@10 -- # set +x 00:07:01.089 ************************************ 00:07:01.089 END TEST accel_dif_generate_copy 00:07:01.089 ************************************ 00:07:01.089 17:55:09 -- accel/accel.sh@115 -- # [[ y == y ]] 00:07:01.089 17:55:09 -- accel/accel.sh@116 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.089 17:55:09 -- common/autotest_common.sh@1097 -- # '[' 8 -le 1 ']' 00:07:01.089 17:55:09 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:01.089 17:55:09 -- common/autotest_common.sh@10 -- # set +x 00:07:01.089 ************************************ 00:07:01.089 START TEST accel_comp 00:07:01.089 ************************************ 00:07:01.089 17:55:10 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.089 17:55:10 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.089 17:55:10 -- accel/accel.sh@17 -- # local accel_module 00:07:01.089 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.089 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.089 17:55:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.089 17:55:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.089 17:55:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.089 17:55:10 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:01.089 17:55:10 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:01.089 17:55:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.089 17:55:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.089 17:55:10 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:01.089 17:55:10 -- accel/accel.sh@40 -- # local IFS=, 00:07:01.089 17:55:10 -- accel/accel.sh@41 -- # jq -r . 00:07:01.089 [2024-04-26 17:55:10.089078] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:01.089 [2024-04-26 17:55:10.089167] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845625 ] 00:07:01.089 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.089 [2024-04-26 17:55:10.163792] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.089 [2024-04-26 17:55:10.250129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=0x1 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=compress 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@23 -- # accel_opc=compress 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=software 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@22 -- # accel_module=software 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=32 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=32 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=1 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val=No 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:01.348 17:55:10 -- accel/accel.sh@20 -- # val= 00:07:01.348 17:55:10 -- accel/accel.sh@21 -- # case "$var" in 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # IFS=: 00:07:01.348 17:55:10 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.284 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.284 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.284 17:55:11 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:02.284 17:55:11 -- accel/accel.sh@27 -- # [[ -n compress ]] 00:07:02.285 17:55:11 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.285 00:07:02.285 real 0m1.412s 00:07:02.285 user 0m1.269s 00:07:02.285 sys 0m0.147s 00:07:02.285 17:55:11 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:02.285 17:55:11 -- common/autotest_common.sh@10 -- # set +x 00:07:02.285 ************************************ 00:07:02.285 END TEST accel_comp 00:07:02.285 ************************************ 00:07:02.543 17:55:11 -- accel/accel.sh@117 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:02.543 17:55:11 -- common/autotest_common.sh@1097 -- # '[' 9 -le 1 ']' 00:07:02.543 17:55:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:02.543 17:55:11 -- common/autotest_common.sh@10 -- # set +x 00:07:02.543 ************************************ 00:07:02.543 START TEST accel_decomp 00:07:02.543 ************************************ 00:07:02.543 17:55:11 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:02.543 17:55:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.543 17:55:11 -- accel/accel.sh@17 -- # local accel_module 00:07:02.543 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.543 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.544 17:55:11 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:02.544 17:55:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y 00:07:02.544 17:55:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.544 17:55:11 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:02.544 17:55:11 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:02.544 17:55:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.544 17:55:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.544 17:55:11 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:02.544 17:55:11 -- accel/accel.sh@40 -- # local IFS=, 00:07:02.544 17:55:11 -- accel/accel.sh@41 -- # jq -r . 00:07:02.544 [2024-04-26 17:55:11.689851] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:02.544 [2024-04-26 17:55:11.689907] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid845865 ] 00:07:02.544 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.803 [2024-04-26 17:55:11.761311] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.803 [2024-04-26 17:55:11.841853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=0x1 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=decompress 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=software 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@22 -- # accel_module=software 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=32 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=32 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=1 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val=Yes 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:02.803 17:55:11 -- accel/accel.sh@20 -- # val= 00:07:02.803 17:55:11 -- accel/accel.sh@21 -- # case "$var" in 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # IFS=: 00:07:02.803 17:55:11 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.180 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:04.180 17:55:13 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:04.180 17:55:13 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:04.180 00:07:04.180 real 0m1.410s 00:07:04.180 user 0m1.270s 00:07:04.180 sys 0m0.144s 00:07:04.180 17:55:13 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:04.180 17:55:13 -- common/autotest_common.sh@10 -- # set +x 00:07:04.180 ************************************ 00:07:04.180 END TEST accel_decomp 00:07:04.180 ************************************ 00:07:04.180 17:55:13 -- accel/accel.sh@118 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:04.180 17:55:13 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:07:04.180 17:55:13 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:04.180 17:55:13 -- common/autotest_common.sh@10 -- # set +x 00:07:04.180 ************************************ 00:07:04.180 START TEST accel_decmop_full 00:07:04.180 ************************************ 00:07:04.180 17:55:13 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:04.180 17:55:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:04.180 17:55:13 -- accel/accel.sh@17 -- # local accel_module 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.180 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.180 17:55:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:04.180 17:55:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:04.180 17:55:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.180 17:55:13 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:04.180 17:55:13 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:04.180 17:55:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.180 17:55:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.180 17:55:13 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:04.180 17:55:13 -- accel/accel.sh@40 -- # local IFS=, 00:07:04.180 17:55:13 -- accel/accel.sh@41 -- # jq -r . 00:07:04.180 [2024-04-26 17:55:13.283553] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:04.180 [2024-04-26 17:55:13.283609] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846071 ] 00:07:04.180 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.180 [2024-04-26 17:55:13.354731] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.439 [2024-04-26 17:55:13.436919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=0x1 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=decompress 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=software 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@22 -- # accel_module=software 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=32 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=32 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=1 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val=Yes 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:04.439 17:55:13 -- accel/accel.sh@20 -- # val= 00:07:04.439 17:55:13 -- accel/accel.sh@21 -- # case "$var" in 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # IFS=: 00:07:04.439 17:55:13 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@20 -- # val= 00:07:05.815 17:55:14 -- accel/accel.sh@21 -- # case "$var" in 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:05.815 17:55:14 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:05.815 17:55:14 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.815 00:07:05.815 real 0m1.414s 00:07:05.815 user 0m1.273s 00:07:05.815 sys 0m0.145s 00:07:05.815 17:55:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:05.815 17:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:05.815 ************************************ 00:07:05.815 END TEST accel_decmop_full 00:07:05.815 ************************************ 00:07:05.815 17:55:14 -- accel/accel.sh@119 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:05.815 17:55:14 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:07:05.815 17:55:14 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:05.815 17:55:14 -- common/autotest_common.sh@10 -- # set +x 00:07:05.815 ************************************ 00:07:05.815 START TEST accel_decomp_mcore 00:07:05.815 ************************************ 00:07:05.815 17:55:14 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:05.815 17:55:14 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.815 17:55:14 -- accel/accel.sh@17 -- # local accel_module 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # IFS=: 00:07:05.815 17:55:14 -- accel/accel.sh@19 -- # read -r var val 00:07:05.815 17:55:14 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:05.815 17:55:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:05.815 17:55:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.815 17:55:14 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:05.815 17:55:14 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:05.815 17:55:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.815 17:55:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.815 17:55:14 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:05.815 17:55:14 -- accel/accel.sh@40 -- # local IFS=, 00:07:05.815 17:55:14 -- accel/accel.sh@41 -- # jq -r . 00:07:05.815 [2024-04-26 17:55:14.877307] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:05.815 [2024-04-26 17:55:14.877368] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846289 ] 00:07:05.815 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.815 [2024-04-26 17:55:14.947377] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:06.075 [2024-04-26 17:55:15.028366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:06.075 [2024-04-26 17:55:15.028452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:06.075 [2024-04-26 17:55:15.028528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:06.075 [2024-04-26 17:55:15.028530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=0xf 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=decompress 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=software 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@22 -- # accel_module=software 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=32 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=32 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=1 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val=Yes 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:06.075 17:55:15 -- accel/accel.sh@20 -- # val= 00:07:06.075 17:55:15 -- accel/accel.sh@21 -- # case "$var" in 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # IFS=: 00:07:06.075 17:55:15 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.453 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:07.453 17:55:16 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:07.453 17:55:16 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.453 00:07:07.453 real 0m1.402s 00:07:07.453 user 0m4.620s 00:07:07.453 sys 0m0.140s 00:07:07.453 17:55:16 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:07.453 17:55:16 -- common/autotest_common.sh@10 -- # set +x 00:07:07.453 ************************************ 00:07:07.453 END TEST accel_decomp_mcore 00:07:07.453 ************************************ 00:07:07.453 17:55:16 -- accel/accel.sh@120 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:07.453 17:55:16 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:07:07.453 17:55:16 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:07.453 17:55:16 -- common/autotest_common.sh@10 -- # set +x 00:07:07.453 ************************************ 00:07:07.453 START TEST accel_decomp_full_mcore 00:07:07.453 ************************************ 00:07:07.453 17:55:16 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:07.453 17:55:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.453 17:55:16 -- accel/accel.sh@17 -- # local accel_module 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.453 17:55:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:07.453 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.453 17:55:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:07.453 17:55:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.453 17:55:16 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:07.453 17:55:16 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:07.453 17:55:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.453 17:55:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.453 17:55:16 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:07.453 17:55:16 -- accel/accel.sh@40 -- # local IFS=, 00:07:07.453 17:55:16 -- accel/accel.sh@41 -- # jq -r . 00:07:07.453 [2024-04-26 17:55:16.470206] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:07.453 [2024-04-26 17:55:16.470265] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846496 ] 00:07:07.453 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.453 [2024-04-26 17:55:16.542694] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:07.453 [2024-04-26 17:55:16.629704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:07.453 [2024-04-26 17:55:16.629792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:07.453 [2024-04-26 17:55:16.629868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:07.453 [2024-04-26 17:55:16.629870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=0xf 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=decompress 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=software 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@22 -- # accel_module=software 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=32 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=32 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=1 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val=Yes 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:07.713 17:55:16 -- accel/accel.sh@20 -- # val= 00:07:07.713 17:55:16 -- accel/accel.sh@21 -- # case "$var" in 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # IFS=: 00:07:07.713 17:55:16 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@20 -- # val= 00:07:09.089 17:55:17 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:17 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:17 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:09.089 17:55:17 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:09.089 17:55:17 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.089 00:07:09.089 real 0m1.437s 00:07:09.089 user 0m4.705s 00:07:09.089 sys 0m0.150s 00:07:09.089 17:55:17 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:09.089 17:55:17 -- common/autotest_common.sh@10 -- # set +x 00:07:09.089 ************************************ 00:07:09.089 END TEST accel_decomp_full_mcore 00:07:09.089 ************************************ 00:07:09.089 17:55:17 -- accel/accel.sh@121 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:09.089 17:55:17 -- common/autotest_common.sh@1097 -- # '[' 11 -le 1 ']' 00:07:09.089 17:55:17 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:09.089 17:55:17 -- common/autotest_common.sh@10 -- # set +x 00:07:09.089 ************************************ 00:07:09.089 START TEST accel_decomp_mthread 00:07:09.089 ************************************ 00:07:09.089 17:55:18 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:09.089 17:55:18 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.089 17:55:18 -- accel/accel.sh@17 -- # local accel_module 00:07:09.089 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.089 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.089 17:55:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:09.089 17:55:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:09.089 17:55:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.089 17:55:18 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:09.089 17:55:18 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:09.089 17:55:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.089 17:55:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.089 17:55:18 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:09.089 17:55:18 -- accel/accel.sh@40 -- # local IFS=, 00:07:09.089 17:55:18 -- accel/accel.sh@41 -- # jq -r . 00:07:09.090 [2024-04-26 17:55:18.107460] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:09.090 [2024-04-26 17:55:18.107521] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid846754 ] 00:07:09.090 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.090 [2024-04-26 17:55:18.182241] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.090 [2024-04-26 17:55:18.266635] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=0x1 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=decompress 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val='4096 bytes' 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=software 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@22 -- # accel_module=software 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=32 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=32 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=2 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val=Yes 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:09.348 17:55:18 -- accel/accel.sh@20 -- # val= 00:07:09.348 17:55:18 -- accel/accel.sh@21 -- # case "$var" in 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # IFS=: 00:07:09.348 17:55:18 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.725 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:10.725 17:55:19 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:10.725 17:55:19 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.725 00:07:10.725 real 0m1.423s 00:07:10.725 user 0m1.294s 00:07:10.725 sys 0m0.144s 00:07:10.725 17:55:19 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:10.725 17:55:19 -- common/autotest_common.sh@10 -- # set +x 00:07:10.725 ************************************ 00:07:10.725 END TEST accel_decomp_mthread 00:07:10.725 ************************************ 00:07:10.725 17:55:19 -- accel/accel.sh@122 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:10.725 17:55:19 -- common/autotest_common.sh@1097 -- # '[' 13 -le 1 ']' 00:07:10.725 17:55:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:10.725 17:55:19 -- common/autotest_common.sh@10 -- # set +x 00:07:10.725 ************************************ 00:07:10.725 START TEST accel_deomp_full_mthread 00:07:10.725 ************************************ 00:07:10.725 17:55:19 -- common/autotest_common.sh@1121 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:10.725 17:55:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.725 17:55:19 -- accel/accel.sh@17 -- # local accel_module 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.725 17:55:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:10.725 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.725 17:55:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:10.725 17:55:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.725 17:55:19 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:10.725 17:55:19 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:10.725 17:55:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.725 17:55:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.725 17:55:19 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:10.725 17:55:19 -- accel/accel.sh@40 -- # local IFS=, 00:07:10.725 17:55:19 -- accel/accel.sh@41 -- # jq -r . 00:07:10.725 [2024-04-26 17:55:19.726204] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:10.725 [2024-04-26 17:55:19.726261] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847087 ] 00:07:10.725 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.725 [2024-04-26 17:55:19.799462] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.725 [2024-04-26 17:55:19.889829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val=0x1 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val=decompress 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@23 -- # accel_opc=decompress 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val='111250 bytes' 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val=software 00:07:10.984 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.984 17:55:19 -- accel/accel.sh@22 -- # accel_module=software 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.984 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.984 17:55:19 -- accel/accel.sh@20 -- # val=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/bib 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val=32 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val=32 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val=2 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val='1 seconds' 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val=Yes 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:10.985 17:55:19 -- accel/accel.sh@20 -- # val= 00:07:10.985 17:55:19 -- accel/accel.sh@21 -- # case "$var" in 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # IFS=: 00:07:10.985 17:55:19 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@20 -- # val= 00:07:12.404 17:55:21 -- accel/accel.sh@21 -- # case "$var" in 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # IFS=: 00:07:12.404 17:55:21 -- accel/accel.sh@19 -- # read -r var val 00:07:12.404 17:55:21 -- accel/accel.sh@27 -- # [[ -n software ]] 00:07:12.404 17:55:21 -- accel/accel.sh@27 -- # [[ -n decompress ]] 00:07:12.404 17:55:21 -- accel/accel.sh@27 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:12.404 00:07:12.404 real 0m1.450s 00:07:12.404 user 0m1.323s 00:07:12.404 sys 0m0.139s 00:07:12.404 17:55:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:12.404 17:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:12.404 ************************************ 00:07:12.404 END TEST accel_deomp_full_mthread 00:07:12.404 ************************************ 00:07:12.404 17:55:21 -- accel/accel.sh@124 -- # [[ n == y ]] 00:07:12.404 17:55:21 -- accel/accel.sh@137 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:12.404 17:55:21 -- accel/accel.sh@137 -- # build_accel_config 00:07:12.404 17:55:21 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:12.404 17:55:21 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:12.404 17:55:21 -- accel/accel.sh@31 -- # accel_json_cfg=() 00:07:12.404 17:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:12.404 17:55:21 -- accel/accel.sh@32 -- # [[ 0 -gt 0 ]] 00:07:12.404 17:55:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.404 17:55:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.404 17:55:21 -- accel/accel.sh@36 -- # [[ -n '' ]] 00:07:12.404 17:55:21 -- accel/accel.sh@40 -- # local IFS=, 00:07:12.404 17:55:21 -- accel/accel.sh@41 -- # jq -r . 00:07:12.404 ************************************ 00:07:12.404 START TEST accel_dif_functional_tests 00:07:12.404 ************************************ 00:07:12.404 17:55:21 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:12.404 [2024-04-26 17:55:21.389592] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:12.404 [2024-04-26 17:55:21.389640] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847300 ] 00:07:12.404 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.404 [2024-04-26 17:55:21.459465] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:12.404 [2024-04-26 17:55:21.548475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:12.404 [2024-04-26 17:55:21.548564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:12.404 [2024-04-26 17:55:21.548568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.716 00:07:12.716 00:07:12.716 CUnit - A unit testing framework for C - Version 2.1-3 00:07:12.716 http://cunit.sourceforge.net/ 00:07:12.716 00:07:12.716 00:07:12.716 Suite: accel_dif 00:07:12.716 Test: verify: DIF generated, GUARD check ...passed 00:07:12.716 Test: verify: DIF generated, APPTAG check ...passed 00:07:12.716 Test: verify: DIF generated, REFTAG check ...passed 00:07:12.716 Test: verify: DIF not generated, GUARD check ...[2024-04-26 17:55:21.628982] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:12.716 [2024-04-26 17:55:21.629033] dif.c: 826:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:12.716 passed 00:07:12.716 Test: verify: DIF not generated, APPTAG check ...[2024-04-26 17:55:21.629063] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:12.716 [2024-04-26 17:55:21.629081] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:12.716 passed 00:07:12.716 Test: verify: DIF not generated, REFTAG check ...[2024-04-26 17:55:21.629100] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:12.716 [2024-04-26 17:55:21.629119] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:12.716 passed 00:07:12.716 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:12.716 Test: verify: APPTAG incorrect, APPTAG check ...[2024-04-26 17:55:21.629164] dif.c: 841:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:12.716 passed 00:07:12.716 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:12.716 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:12.716 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:12.716 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-04-26 17:55:21.629268] dif.c: 776:_dif_reftag_check: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:12.716 passed 00:07:12.716 Test: generate copy: DIF generated, GUARD check ...passed 00:07:12.716 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:12.716 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:12.716 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:12.716 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:12.716 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:12.716 Test: generate copy: iovecs-len validate ...[2024-04-26 17:55:21.629451] dif.c:1190:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:12.716 passed 00:07:12.716 Test: generate copy: buffer alignment validate ...passed 00:07:12.716 00:07:12.716 Run Summary: Type Total Ran Passed Failed Inactive 00:07:12.716 suites 1 1 n/a 0 0 00:07:12.716 tests 20 20 20 0 0 00:07:12.716 asserts 204 204 204 0 n/a 00:07:12.716 00:07:12.716 Elapsed time = 0.002 seconds 00:07:12.716 00:07:12.716 real 0m0.500s 00:07:12.716 user 0m0.703s 00:07:12.716 sys 0m0.168s 00:07:12.716 17:55:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:12.716 17:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:12.716 ************************************ 00:07:12.716 END TEST accel_dif_functional_tests 00:07:12.716 ************************************ 00:07:12.716 00:07:12.716 real 0m35.916s 00:07:12.716 user 0m36.955s 00:07:12.716 sys 0m6.484s 00:07:12.716 17:55:21 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:12.716 17:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:12.716 ************************************ 00:07:12.716 END TEST accel 00:07:12.716 ************************************ 00:07:12.975 17:55:21 -- spdk/autotest.sh@180 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:12.975 17:55:21 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:07:12.975 17:55:21 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:12.975 17:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:12.975 ************************************ 00:07:12.975 START TEST accel_rpc 00:07:12.975 ************************************ 00:07:12.975 17:55:22 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:13.234 * Looking for test storage... 00:07:13.234 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/accel 00:07:13.234 17:55:22 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:13.234 17:55:22 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=847429 00:07:13.234 17:55:22 -- accel/accel_rpc.sh@15 -- # waitforlisten 847429 00:07:13.234 17:55:22 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:13.234 17:55:22 -- common/autotest_common.sh@827 -- # '[' -z 847429 ']' 00:07:13.234 17:55:22 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:13.234 17:55:22 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:13.234 17:55:22 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:13.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:13.234 17:55:22 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:13.234 17:55:22 -- common/autotest_common.sh@10 -- # set +x 00:07:13.234 [2024-04-26 17:55:22.262573] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:13.234 [2024-04-26 17:55:22.262640] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847429 ] 00:07:13.234 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.234 [2024-04-26 17:55:22.345833] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.492 [2024-04-26 17:55:22.436384] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.060 17:55:23 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:14.060 17:55:23 -- common/autotest_common.sh@860 -- # return 0 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:14.060 17:55:23 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:07:14.060 17:55:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:14.060 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.060 ************************************ 00:07:14.060 START TEST accel_assign_opcode 00:07:14.060 ************************************ 00:07:14.060 17:55:23 -- common/autotest_common.sh@1121 -- # accel_assign_opcode_test_suite 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:14.060 17:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:14.060 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.060 [2024-04-26 17:55:23.234726] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:14.060 17:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:14.060 17:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:14.060 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.060 [2024-04-26 17:55:23.242762] accel_rpc.c: 167:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:14.060 17:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:14.060 17:55:23 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:14.060 17:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:14.060 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.319 17:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:14.319 17:55:23 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:14.319 17:55:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:14.319 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.319 17:55:23 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:14.319 17:55:23 -- accel/accel_rpc.sh@42 -- # grep software 00:07:14.319 17:55:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:14.319 software 00:07:14.319 00:07:14.319 real 0m0.242s 00:07:14.319 user 0m0.030s 00:07:14.319 sys 0m0.007s 00:07:14.319 17:55:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:14.319 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.319 ************************************ 00:07:14.319 END TEST accel_assign_opcode 00:07:14.319 ************************************ 00:07:14.319 17:55:23 -- accel/accel_rpc.sh@55 -- # killprocess 847429 00:07:14.319 17:55:23 -- common/autotest_common.sh@946 -- # '[' -z 847429 ']' 00:07:14.319 17:55:23 -- common/autotest_common.sh@950 -- # kill -0 847429 00:07:14.579 17:55:23 -- common/autotest_common.sh@951 -- # uname 00:07:14.579 17:55:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:14.579 17:55:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 847429 00:07:14.579 17:55:23 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:14.579 17:55:23 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:14.579 17:55:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 847429' 00:07:14.579 killing process with pid 847429 00:07:14.579 17:55:23 -- common/autotest_common.sh@965 -- # kill 847429 00:07:14.579 17:55:23 -- common/autotest_common.sh@970 -- # wait 847429 00:07:14.838 00:07:14.838 real 0m1.805s 00:07:14.838 user 0m1.828s 00:07:14.838 sys 0m0.570s 00:07:14.838 17:55:23 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:14.838 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:14.838 ************************************ 00:07:14.838 END TEST accel_rpc 00:07:14.838 ************************************ 00:07:14.838 17:55:23 -- spdk/autotest.sh@181 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:14.838 17:55:23 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:07:14.838 17:55:23 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:14.838 17:55:23 -- common/autotest_common.sh@10 -- # set +x 00:07:15.098 ************************************ 00:07:15.098 START TEST app_cmdline 00:07:15.098 ************************************ 00:07:15.098 17:55:24 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/cmdline.sh 00:07:15.098 * Looking for test storage... 00:07:15.098 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:15.098 17:55:24 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:15.098 17:55:24 -- app/cmdline.sh@17 -- # spdk_tgt_pid=847826 00:07:15.098 17:55:24 -- app/cmdline.sh@18 -- # waitforlisten 847826 00:07:15.098 17:55:24 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:15.098 17:55:24 -- common/autotest_common.sh@827 -- # '[' -z 847826 ']' 00:07:15.098 17:55:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:15.098 17:55:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:15.098 17:55:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:15.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:15.098 17:55:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:15.098 17:55:24 -- common/autotest_common.sh@10 -- # set +x 00:07:15.098 [2024-04-26 17:55:24.256051] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:15.098 [2024-04-26 17:55:24.256109] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid847826 ] 00:07:15.098 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.358 [2024-04-26 17:55:24.328366] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.358 [2024-04-26 17:55:24.413729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.926 17:55:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:15.926 17:55:25 -- common/autotest_common.sh@860 -- # return 0 00:07:15.926 17:55:25 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:16.185 { 00:07:16.185 "version": "SPDK v24.05-pre git sha1 c1efd80ca", 00:07:16.185 "fields": { 00:07:16.185 "major": 24, 00:07:16.185 "minor": 5, 00:07:16.185 "patch": 0, 00:07:16.185 "suffix": "-pre", 00:07:16.185 "commit": "c1efd80ca" 00:07:16.185 } 00:07:16.185 } 00:07:16.185 17:55:25 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:16.185 17:55:25 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:16.185 17:55:25 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:16.185 17:55:25 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:16.185 17:55:25 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:16.185 17:55:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:16.185 17:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:16.185 17:55:25 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:16.185 17:55:25 -- app/cmdline.sh@26 -- # sort 00:07:16.185 17:55:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:16.185 17:55:25 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:16.185 17:55:25 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:16.185 17:55:25 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:16.185 17:55:25 -- common/autotest_common.sh@648 -- # local es=0 00:07:16.185 17:55:25 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:16.185 17:55:25 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:16.185 17:55:25 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:07:16.185 17:55:25 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:16.185 17:55:25 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:07:16.185 17:55:25 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:16.185 17:55:25 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:07:16.185 17:55:25 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:07:16.185 17:55:25 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:07:16.185 17:55:25 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:16.445 request: 00:07:16.445 { 00:07:16.445 "method": "env_dpdk_get_mem_stats", 00:07:16.445 "req_id": 1 00:07:16.445 } 00:07:16.445 Got JSON-RPC error response 00:07:16.445 response: 00:07:16.445 { 00:07:16.445 "code": -32601, 00:07:16.445 "message": "Method not found" 00:07:16.445 } 00:07:16.445 17:55:25 -- common/autotest_common.sh@651 -- # es=1 00:07:16.445 17:55:25 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:07:16.445 17:55:25 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:07:16.445 17:55:25 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:07:16.445 17:55:25 -- app/cmdline.sh@1 -- # killprocess 847826 00:07:16.445 17:55:25 -- common/autotest_common.sh@946 -- # '[' -z 847826 ']' 00:07:16.445 17:55:25 -- common/autotest_common.sh@950 -- # kill -0 847826 00:07:16.445 17:55:25 -- common/autotest_common.sh@951 -- # uname 00:07:16.445 17:55:25 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:16.445 17:55:25 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 847826 00:07:16.445 17:55:25 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:16.445 17:55:25 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:16.445 17:55:25 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 847826' 00:07:16.445 killing process with pid 847826 00:07:16.445 17:55:25 -- common/autotest_common.sh@965 -- # kill 847826 00:07:16.445 17:55:25 -- common/autotest_common.sh@970 -- # wait 847826 00:07:16.704 00:07:16.704 real 0m1.791s 00:07:16.704 user 0m2.067s 00:07:16.704 sys 0m0.507s 00:07:16.704 17:55:25 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:16.704 17:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:16.704 ************************************ 00:07:16.704 END TEST app_cmdline 00:07:16.704 ************************************ 00:07:16.963 17:55:25 -- spdk/autotest.sh@182 -- # run_test version /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:16.963 17:55:25 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:07:16.963 17:55:25 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:16.963 17:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:16.963 ************************************ 00:07:16.963 START TEST version 00:07:16.963 ************************************ 00:07:16.963 17:55:26 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/version.sh 00:07:17.223 * Looking for test storage... 00:07:17.223 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:17.223 17:55:26 -- app/version.sh@17 -- # get_header_version major 00:07:17.223 17:55:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:17.223 17:55:26 -- app/version.sh@14 -- # cut -f2 00:07:17.223 17:55:26 -- app/version.sh@14 -- # tr -d '"' 00:07:17.223 17:55:26 -- app/version.sh@17 -- # major=24 00:07:17.223 17:55:26 -- app/version.sh@18 -- # get_header_version minor 00:07:17.223 17:55:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:17.223 17:55:26 -- app/version.sh@14 -- # cut -f2 00:07:17.223 17:55:26 -- app/version.sh@14 -- # tr -d '"' 00:07:17.223 17:55:26 -- app/version.sh@18 -- # minor=5 00:07:17.223 17:55:26 -- app/version.sh@19 -- # get_header_version patch 00:07:17.223 17:55:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:17.223 17:55:26 -- app/version.sh@14 -- # tr -d '"' 00:07:17.223 17:55:26 -- app/version.sh@14 -- # cut -f2 00:07:17.223 17:55:26 -- app/version.sh@19 -- # patch=0 00:07:17.223 17:55:26 -- app/version.sh@20 -- # get_header_version suffix 00:07:17.223 17:55:26 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/version.h 00:07:17.223 17:55:26 -- app/version.sh@14 -- # cut -f2 00:07:17.223 17:55:26 -- app/version.sh@14 -- # tr -d '"' 00:07:17.223 17:55:26 -- app/version.sh@20 -- # suffix=-pre 00:07:17.223 17:55:26 -- app/version.sh@22 -- # version=24.5 00:07:17.223 17:55:26 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:17.223 17:55:26 -- app/version.sh@28 -- # version=24.5rc0 00:07:17.223 17:55:26 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:17.223 17:55:26 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:17.223 17:55:26 -- app/version.sh@30 -- # py_version=24.5rc0 00:07:17.223 17:55:26 -- app/version.sh@31 -- # [[ 24.5rc0 == \2\4\.\5\r\c\0 ]] 00:07:17.223 00:07:17.223 real 0m0.191s 00:07:17.223 user 0m0.085s 00:07:17.223 sys 0m0.146s 00:07:17.223 17:55:26 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:17.223 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:17.223 ************************************ 00:07:17.223 END TEST version 00:07:17.223 ************************************ 00:07:17.223 17:55:26 -- spdk/autotest.sh@184 -- # '[' 0 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@194 -- # uname -s 00:07:17.223 17:55:26 -- spdk/autotest.sh@194 -- # [[ Linux == Linux ]] 00:07:17.223 17:55:26 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:17.223 17:55:26 -- spdk/autotest.sh@195 -- # [[ 0 -eq 1 ]] 00:07:17.223 17:55:26 -- spdk/autotest.sh@207 -- # '[' 0 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@254 -- # '[' 0 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@258 -- # timing_exit lib 00:07:17.223 17:55:26 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:17.223 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:17.223 17:55:26 -- spdk/autotest.sh@260 -- # '[' 0 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@268 -- # '[' 0 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@277 -- # '[' 1 -eq 1 ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@278 -- # export NET_TYPE 00:07:17.223 17:55:26 -- spdk/autotest.sh@281 -- # '[' rdma = rdma ']' 00:07:17.223 17:55:26 -- spdk/autotest.sh@282 -- # run_test nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:17.223 17:55:26 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:17.223 17:55:26 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:17.223 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:17.483 ************************************ 00:07:17.483 START TEST nvmf_rdma 00:07:17.483 ************************************ 00:07:17.483 17:55:26 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=rdma 00:07:17.483 * Looking for test storage... 00:07:17.483 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf 00:07:17.483 17:55:26 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:17.483 17:55:26 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:17.483 17:55:26 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:17.483 17:55:26 -- nvmf/common.sh@7 -- # uname -s 00:07:17.483 17:55:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:17.483 17:55:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:17.483 17:55:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:17.483 17:55:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:17.483 17:55:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:17.483 17:55:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:17.483 17:55:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:17.483 17:55:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:17.483 17:55:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:17.483 17:55:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:17.483 17:55:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:07:17.483 17:55:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:07:17.483 17:55:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:17.484 17:55:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:17.484 17:55:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:17.484 17:55:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:17.484 17:55:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:17.484 17:55:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:17.484 17:55:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:17.484 17:55:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:17.484 17:55:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.484 17:55:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.484 17:55:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.484 17:55:26 -- paths/export.sh@5 -- # export PATH 00:07:17.484 17:55:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:17.484 17:55:26 -- nvmf/common.sh@47 -- # : 0 00:07:17.484 17:55:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:17.484 17:55:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:17.484 17:55:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:17.484 17:55:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:17.484 17:55:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:17.484 17:55:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:17.484 17:55:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:17.484 17:55:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:17.484 17:55:26 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:17.484 17:55:26 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:17.484 17:55:26 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:17.484 17:55:26 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:17.484 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:17.484 17:55:26 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:17.484 17:55:26 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:17.484 17:55:26 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:17.484 17:55:26 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:17.484 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:17.743 ************************************ 00:07:17.743 START TEST nvmf_example 00:07:17.743 ************************************ 00:07:17.743 17:55:26 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=rdma 00:07:17.743 * Looking for test storage... 00:07:17.743 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:17.743 17:55:26 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:17.743 17:55:26 -- nvmf/common.sh@7 -- # uname -s 00:07:17.743 17:55:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:17.743 17:55:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:17.743 17:55:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:17.743 17:55:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:17.743 17:55:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:17.743 17:55:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:17.743 17:55:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:17.743 17:55:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:17.743 17:55:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:17.743 17:55:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:17.743 17:55:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:07:17.744 17:55:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:07:17.744 17:55:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:17.744 17:55:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:17.744 17:55:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:17.744 17:55:26 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:17.744 17:55:26 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:18.003 17:55:26 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:18.003 17:55:26 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:18.003 17:55:26 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:18.003 17:55:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.003 17:55:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.003 17:55:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.003 17:55:26 -- paths/export.sh@5 -- # export PATH 00:07:18.003 17:55:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:18.003 17:55:26 -- nvmf/common.sh@47 -- # : 0 00:07:18.003 17:55:26 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:18.003 17:55:26 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:18.003 17:55:26 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:18.003 17:55:26 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:18.003 17:55:26 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:18.003 17:55:26 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:18.003 17:55:26 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:18.003 17:55:26 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:18.003 17:55:26 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:18.003 17:55:26 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:18.003 17:55:26 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:18.003 17:55:26 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:18.003 17:55:26 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:18.003 17:55:26 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:18.003 17:55:26 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:18.003 17:55:26 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:18.003 17:55:26 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:18.003 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:18.003 17:55:26 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:18.003 17:55:26 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:18.003 17:55:26 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:18.003 17:55:26 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:18.003 17:55:26 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:18.003 17:55:26 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:18.003 17:55:26 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:18.003 17:55:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:18.003 17:55:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:18.003 17:55:26 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:18.003 17:55:26 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:18.003 17:55:26 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:18.003 17:55:26 -- common/autotest_common.sh@10 -- # set +x 00:07:24.573 17:55:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:24.573 17:55:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:24.573 17:55:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:24.573 17:55:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:24.573 17:55:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:24.573 17:55:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:24.573 17:55:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:24.573 17:55:33 -- nvmf/common.sh@295 -- # net_devs=() 00:07:24.573 17:55:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:24.573 17:55:33 -- nvmf/common.sh@296 -- # e810=() 00:07:24.573 17:55:33 -- nvmf/common.sh@296 -- # local -ga e810 00:07:24.573 17:55:33 -- nvmf/common.sh@297 -- # x722=() 00:07:24.573 17:55:33 -- nvmf/common.sh@297 -- # local -ga x722 00:07:24.573 17:55:33 -- nvmf/common.sh@298 -- # mlx=() 00:07:24.573 17:55:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:24.573 17:55:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:24.573 17:55:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:24.574 17:55:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:24.574 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:24.574 17:55:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:24.574 17:55:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:24.574 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:24.574 17:55:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:24.574 17:55:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.574 17:55:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.574 17:55:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:24.574 Found net devices under 0000:18:00.0: mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:24.574 17:55:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:24.574 17:55:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:24.574 Found net devices under 0000:18:00.1: mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:24.574 17:55:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:24.574 17:55:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:24.574 17:55:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:24.574 17:55:33 -- nvmf/common.sh@58 -- # uname 00:07:24.574 17:55:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:24.574 17:55:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:24.574 17:55:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:24.574 17:55:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:24.574 17:55:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:24.574 17:55:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:24.574 17:55:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:24.574 17:55:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:24.574 17:55:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:24.574 17:55:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:24.574 17:55:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:24.574 17:55:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:24.574 17:55:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:24.574 17:55:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:24.574 17:55:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:24.574 17:55:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@105 -- # continue 2 00:07:24.574 17:55:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@105 -- # continue 2 00:07:24.574 17:55:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:24.574 17:55:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:24.574 17:55:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:24.574 17:55:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:24.574 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:24.574 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:07:24.574 altname enp24s0f0np0 00:07:24.574 altname ens785f0np0 00:07:24.574 inet 192.168.100.8/24 scope global mlx_0_0 00:07:24.574 valid_lft forever preferred_lft forever 00:07:24.574 17:55:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:24.574 17:55:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:24.574 17:55:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:24.574 17:55:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:24.574 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:24.574 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:07:24.574 altname enp24s0f1np1 00:07:24.574 altname ens785f1np1 00:07:24.574 inet 192.168.100.9/24 scope global mlx_0_1 00:07:24.574 valid_lft forever preferred_lft forever 00:07:24.574 17:55:33 -- nvmf/common.sh@411 -- # return 0 00:07:24.574 17:55:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:24.574 17:55:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:24.574 17:55:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:24.574 17:55:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:24.574 17:55:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:24.574 17:55:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:24.574 17:55:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:24.574 17:55:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:24.574 17:55:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:24.574 17:55:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@105 -- # continue 2 00:07:24.574 17:55:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:24.574 17:55:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:24.574 17:55:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@105 -- # continue 2 00:07:24.574 17:55:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:24.574 17:55:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:24.574 17:55:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:24.574 17:55:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:24.574 17:55:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:24.574 17:55:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:24.574 192.168.100.9' 00:07:24.574 17:55:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:24.574 192.168.100.9' 00:07:24.574 17:55:33 -- nvmf/common.sh@446 -- # head -n 1 00:07:24.574 17:55:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:24.574 17:55:33 -- nvmf/common.sh@447 -- # head -n 1 00:07:24.574 17:55:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:24.574 192.168.100.9' 00:07:24.574 17:55:33 -- nvmf/common.sh@447 -- # tail -n +2 00:07:24.575 17:55:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:24.575 17:55:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:24.575 17:55:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:24.575 17:55:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:24.575 17:55:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:24.575 17:55:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:24.575 17:55:33 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:24.575 17:55:33 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:24.575 17:55:33 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:24.575 17:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:24.575 17:55:33 -- target/nvmf_example.sh@29 -- # '[' rdma == tcp ']' 00:07:24.575 17:55:33 -- target/nvmf_example.sh@34 -- # nvmfpid=851147 00:07:24.575 17:55:33 -- target/nvmf_example.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:24.575 17:55:33 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:24.575 17:55:33 -- target/nvmf_example.sh@36 -- # waitforlisten 851147 00:07:24.575 17:55:33 -- common/autotest_common.sh@827 -- # '[' -z 851147 ']' 00:07:24.575 17:55:33 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:24.575 17:55:33 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:24.575 17:55:33 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:24.575 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:24.575 17:55:33 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:24.575 17:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:24.575 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.143 17:55:34 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:25.143 17:55:34 -- common/autotest_common.sh@860 -- # return 0 00:07:25.143 17:55:34 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:25.143 17:55:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:25.143 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.143 17:55:34 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:07:25.143 17:55:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.143 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.402 17:55:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.402 17:55:34 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:25.402 17:55:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.402 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.402 17:55:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.402 17:55:34 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:25.402 17:55:34 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:25.402 17:55:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.402 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.402 17:55:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.402 17:55:34 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:25.402 17:55:34 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:25.402 17:55:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.402 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.402 17:55:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.402 17:55:34 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:25.402 17:55:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:25.402 17:55:34 -- common/autotest_common.sh@10 -- # set +x 00:07:25.402 17:55:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:25.402 17:55:34 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:25.402 17:55:34 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:25.402 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.613 Initializing NVMe Controllers 00:07:37.613 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:07:37.613 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:37.613 Initialization complete. Launching workers. 00:07:37.613 ======================================================== 00:07:37.613 Latency(us) 00:07:37.613 Device Information : IOPS MiB/s Average min max 00:07:37.613 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 26566.00 103.77 2409.21 628.00 13965.52 00:07:37.613 ======================================================== 00:07:37.613 Total : 26566.00 103.77 2409.21 628.00 13965.52 00:07:37.613 00:07:37.613 17:55:45 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:37.613 17:55:45 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:37.613 17:55:45 -- nvmf/common.sh@477 -- # nvmfcleanup 00:07:37.613 17:55:45 -- nvmf/common.sh@117 -- # sync 00:07:37.613 17:55:45 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:07:37.613 17:55:45 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:07:37.614 17:55:45 -- nvmf/common.sh@120 -- # set +e 00:07:37.614 17:55:45 -- nvmf/common.sh@121 -- # for i in {1..20} 00:07:37.614 17:55:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:07:37.614 rmmod nvme_rdma 00:07:37.614 rmmod nvme_fabrics 00:07:37.614 17:55:45 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:07:37.614 17:55:45 -- nvmf/common.sh@124 -- # set -e 00:07:37.614 17:55:45 -- nvmf/common.sh@125 -- # return 0 00:07:37.614 17:55:45 -- nvmf/common.sh@478 -- # '[' -n 851147 ']' 00:07:37.614 17:55:45 -- nvmf/common.sh@479 -- # killprocess 851147 00:07:37.614 17:55:45 -- common/autotest_common.sh@946 -- # '[' -z 851147 ']' 00:07:37.614 17:55:45 -- common/autotest_common.sh@950 -- # kill -0 851147 00:07:37.614 17:55:45 -- common/autotest_common.sh@951 -- # uname 00:07:37.614 17:55:45 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:37.614 17:55:45 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 851147 00:07:37.614 17:55:45 -- common/autotest_common.sh@952 -- # process_name=nvmf 00:07:37.614 17:55:45 -- common/autotest_common.sh@956 -- # '[' nvmf = sudo ']' 00:07:37.614 17:55:45 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 851147' 00:07:37.614 killing process with pid 851147 00:07:37.614 17:55:45 -- common/autotest_common.sh@965 -- # kill 851147 00:07:37.614 17:55:45 -- common/autotest_common.sh@970 -- # wait 851147 00:07:37.614 [2024-04-26 17:55:45.878950] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:37.614 nvmf threads initialize successfully 00:07:37.614 bdev subsystem init successfully 00:07:37.614 created a nvmf target service 00:07:37.614 create targets's poll groups done 00:07:37.614 all subsystems of target started 00:07:37.614 nvmf target is running 00:07:37.614 all subsystems of target stopped 00:07:37.614 destroy targets's poll groups done 00:07:37.614 destroyed the nvmf target service 00:07:37.614 bdev subsystem finish successfully 00:07:37.614 nvmf threads destroy successfully 00:07:37.614 17:55:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:07:37.614 17:55:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:07:37.614 17:55:46 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:37.614 17:55:46 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:37.614 17:55:46 -- common/autotest_common.sh@10 -- # set +x 00:07:37.614 00:07:37.614 real 0m19.322s 00:07:37.614 user 0m52.288s 00:07:37.614 sys 0m5.350s 00:07:37.614 17:55:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:37.614 17:55:46 -- common/autotest_common.sh@10 -- # set +x 00:07:37.614 ************************************ 00:07:37.614 END TEST nvmf_example 00:07:37.614 ************************************ 00:07:37.614 17:55:46 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:07:37.614 17:55:46 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:37.614 17:55:46 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:37.614 17:55:46 -- common/autotest_common.sh@10 -- # set +x 00:07:37.614 ************************************ 00:07:37.614 START TEST nvmf_filesystem 00:07:37.614 ************************************ 00:07:37.614 17:55:46 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=rdma 00:07:37.614 * Looking for test storage... 00:07:37.614 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.614 17:55:46 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:07:37.614 17:55:46 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:37.614 17:55:46 -- common/autotest_common.sh@34 -- # set -e 00:07:37.614 17:55:46 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:37.614 17:55:46 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:37.614 17:55:46 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:07:37.614 17:55:46 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:37.614 17:55:46 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:07:37.614 17:55:46 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:37.614 17:55:46 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:37.614 17:55:46 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:37.614 17:55:46 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:37.614 17:55:46 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:37.614 17:55:46 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:37.614 17:55:46 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:37.614 17:55:46 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:37.614 17:55:46 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:37.614 17:55:46 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:37.614 17:55:46 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:37.614 17:55:46 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:37.614 17:55:46 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:37.614 17:55:46 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:37.614 17:55:46 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:37.614 17:55:46 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:37.614 17:55:46 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:37.614 17:55:46 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:37.614 17:55:46 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:07:37.614 17:55:46 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:37.614 17:55:46 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:37.614 17:55:46 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:37.614 17:55:46 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:37.614 17:55:46 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:37.614 17:55:46 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:37.614 17:55:46 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:37.614 17:55:46 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:37.614 17:55:46 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:37.614 17:55:46 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:37.614 17:55:46 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:37.614 17:55:46 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:37.614 17:55:46 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:37.614 17:55:46 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:37.614 17:55:46 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:37.614 17:55:46 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:37.614 17:55:46 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:07:37.614 17:55:46 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:37.614 17:55:46 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:37.614 17:55:46 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:37.614 17:55:46 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:37.614 17:55:46 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:07:37.614 17:55:46 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:37.614 17:55:46 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:37.614 17:55:46 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:37.614 17:55:46 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:37.614 17:55:46 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:37.614 17:55:46 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:37.614 17:55:46 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:37.614 17:55:46 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:37.614 17:55:46 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:37.614 17:55:46 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:07:37.614 17:55:46 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:37.614 17:55:46 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:07:37.614 17:55:46 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:07:37.614 17:55:46 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:07:37.614 17:55:46 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:07:37.614 17:55:46 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:07:37.614 17:55:46 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:07:37.615 17:55:46 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:07:37.615 17:55:46 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:07:37.615 17:55:46 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:07:37.615 17:55:46 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:07:37.615 17:55:46 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:07:37.615 17:55:46 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:07:37.615 17:55:46 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:07:37.615 17:55:46 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:07:37.615 17:55:46 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:07:37.615 17:55:46 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:37.615 17:55:46 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:07:37.615 17:55:46 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:07:37.615 17:55:46 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:07:37.615 17:55:46 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:07:37.615 17:55:46 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:07:37.615 17:55:46 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:07:37.615 17:55:46 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:07:37.615 17:55:46 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:07:37.615 17:55:46 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:07:37.615 17:55:46 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:07:37.615 17:55:46 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:07:37.615 17:55:46 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:37.615 17:55:46 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:07:37.615 17:55:46 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:07:37.615 17:55:46 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:07:37.615 17:55:46 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:07:37.615 17:55:46 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:07:37.615 17:55:46 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:07:37.615 17:55:46 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:37.615 17:55:46 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:37.615 17:55:46 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:07:37.615 17:55:46 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:37.615 17:55:46 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:37.615 17:55:46 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:37.615 17:55:46 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:37.615 17:55:46 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:37.615 17:55:46 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:37.615 17:55:46 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:37.615 17:55:46 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:07:37.615 17:55:46 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:37.615 #define SPDK_CONFIG_H 00:07:37.615 #define SPDK_CONFIG_APPS 1 00:07:37.615 #define SPDK_CONFIG_ARCH native 00:07:37.615 #undef SPDK_CONFIG_ASAN 00:07:37.615 #undef SPDK_CONFIG_AVAHI 00:07:37.615 #undef SPDK_CONFIG_CET 00:07:37.615 #define SPDK_CONFIG_COVERAGE 1 00:07:37.615 #define SPDK_CONFIG_CROSS_PREFIX 00:07:37.615 #undef SPDK_CONFIG_CRYPTO 00:07:37.615 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:37.615 #undef SPDK_CONFIG_CUSTOMOCF 00:07:37.615 #undef SPDK_CONFIG_DAOS 00:07:37.615 #define SPDK_CONFIG_DAOS_DIR 00:07:37.615 #define SPDK_CONFIG_DEBUG 1 00:07:37.615 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:37.615 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:07:37.615 #define SPDK_CONFIG_DPDK_INC_DIR 00:07:37.615 #define SPDK_CONFIG_DPDK_LIB_DIR 00:07:37.615 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:37.615 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:07:37.615 #define SPDK_CONFIG_EXAMPLES 1 00:07:37.615 #undef SPDK_CONFIG_FC 00:07:37.615 #define SPDK_CONFIG_FC_PATH 00:07:37.615 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:37.615 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:37.615 #undef SPDK_CONFIG_FUSE 00:07:37.615 #undef SPDK_CONFIG_FUZZER 00:07:37.615 #define SPDK_CONFIG_FUZZER_LIB 00:07:37.615 #undef SPDK_CONFIG_GOLANG 00:07:37.615 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:37.615 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:07:37.615 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:37.615 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:07:37.615 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:37.615 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:37.615 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:37.615 #define SPDK_CONFIG_IDXD 1 00:07:37.615 #undef SPDK_CONFIG_IDXD_KERNEL 00:07:37.615 #undef SPDK_CONFIG_IPSEC_MB 00:07:37.615 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:37.615 #define SPDK_CONFIG_ISAL 1 00:07:37.615 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:37.615 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:37.615 #define SPDK_CONFIG_LIBDIR 00:07:37.615 #undef SPDK_CONFIG_LTO 00:07:37.615 #define SPDK_CONFIG_MAX_LCORES 00:07:37.615 #define SPDK_CONFIG_NVME_CUSE 1 00:07:37.615 #undef SPDK_CONFIG_OCF 00:07:37.615 #define SPDK_CONFIG_OCF_PATH 00:07:37.615 #define SPDK_CONFIG_OPENSSL_PATH 00:07:37.615 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:37.615 #define SPDK_CONFIG_PGO_DIR 00:07:37.615 #undef SPDK_CONFIG_PGO_USE 00:07:37.615 #define SPDK_CONFIG_PREFIX /usr/local 00:07:37.615 #undef SPDK_CONFIG_RAID5F 00:07:37.615 #undef SPDK_CONFIG_RBD 00:07:37.615 #define SPDK_CONFIG_RDMA 1 00:07:37.615 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:37.615 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:37.615 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:37.615 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:37.615 #define SPDK_CONFIG_SHARED 1 00:07:37.615 #undef SPDK_CONFIG_SMA 00:07:37.615 #define SPDK_CONFIG_TESTS 1 00:07:37.615 #undef SPDK_CONFIG_TSAN 00:07:37.615 #define SPDK_CONFIG_UBLK 1 00:07:37.615 #define SPDK_CONFIG_UBSAN 1 00:07:37.615 #undef SPDK_CONFIG_UNIT_TESTS 00:07:37.615 #undef SPDK_CONFIG_URING 00:07:37.615 #define SPDK_CONFIG_URING_PATH 00:07:37.615 #undef SPDK_CONFIG_URING_ZNS 00:07:37.615 #undef SPDK_CONFIG_USDT 00:07:37.615 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:37.615 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:37.615 #undef SPDK_CONFIG_VFIO_USER 00:07:37.615 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:37.615 #define SPDK_CONFIG_VHOST 1 00:07:37.615 #define SPDK_CONFIG_VIRTIO 1 00:07:37.615 #undef SPDK_CONFIG_VTUNE 00:07:37.615 #define SPDK_CONFIG_VTUNE_DIR 00:07:37.615 #define SPDK_CONFIG_WERROR 1 00:07:37.615 #define SPDK_CONFIG_WPDK_DIR 00:07:37.615 #undef SPDK_CONFIG_XNVME 00:07:37.615 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:37.615 17:55:46 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:37.615 17:55:46 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:37.615 17:55:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:37.616 17:55:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:37.616 17:55:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:37.616 17:55:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.616 17:55:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.616 17:55:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.616 17:55:46 -- paths/export.sh@5 -- # export PATH 00:07:37.616 17:55:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.616 17:55:46 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:07:37.616 17:55:46 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:07:37.616 17:55:46 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:07:37.616 17:55:46 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:07:37.616 17:55:46 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:37.616 17:55:46 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:07:37.616 17:55:46 -- pm/common@67 -- # TEST_TAG=N/A 00:07:37.616 17:55:46 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:07:37.616 17:55:46 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:07:37.616 17:55:46 -- pm/common@71 -- # uname -s 00:07:37.616 17:55:46 -- pm/common@71 -- # PM_OS=Linux 00:07:37.616 17:55:46 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:07:37.616 17:55:46 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:07:37.616 17:55:46 -- pm/common@76 -- # [[ Linux == Linux ]] 00:07:37.616 17:55:46 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:07:37.616 17:55:46 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:07:37.616 17:55:46 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:07:37.616 17:55:46 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:07:37.616 17:55:46 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:07:37.616 17:55:46 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:07:37.616 17:55:46 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:07:37.616 17:55:46 -- common/autotest_common.sh@57 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:07:37.616 17:55:46 -- common/autotest_common.sh@61 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:37.616 17:55:46 -- common/autotest_common.sh@63 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:07:37.616 17:55:46 -- common/autotest_common.sh@65 -- # : 1 00:07:37.616 17:55:46 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:37.616 17:55:46 -- common/autotest_common.sh@67 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:07:37.616 17:55:46 -- common/autotest_common.sh@69 -- # : 00:07:37.616 17:55:46 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:07:37.616 17:55:46 -- common/autotest_common.sh@71 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:07:37.616 17:55:46 -- common/autotest_common.sh@73 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:07:37.616 17:55:46 -- common/autotest_common.sh@75 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:07:37.616 17:55:46 -- common/autotest_common.sh@77 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:37.616 17:55:46 -- common/autotest_common.sh@79 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:07:37.616 17:55:46 -- common/autotest_common.sh@81 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:07:37.616 17:55:46 -- common/autotest_common.sh@83 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:07:37.616 17:55:46 -- common/autotest_common.sh@85 -- # : 1 00:07:37.616 17:55:46 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:07:37.616 17:55:46 -- common/autotest_common.sh@87 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:07:37.616 17:55:46 -- common/autotest_common.sh@89 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:07:37.616 17:55:46 -- common/autotest_common.sh@91 -- # : 1 00:07:37.616 17:55:46 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:07:37.616 17:55:46 -- common/autotest_common.sh@93 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:07:37.616 17:55:46 -- common/autotest_common.sh@95 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:37.616 17:55:46 -- common/autotest_common.sh@97 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:07:37.616 17:55:46 -- common/autotest_common.sh@99 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:07:37.616 17:55:46 -- common/autotest_common.sh@101 -- # : rdma 00:07:37.616 17:55:46 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:37.616 17:55:46 -- common/autotest_common.sh@103 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:07:37.616 17:55:46 -- common/autotest_common.sh@105 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:07:37.616 17:55:46 -- common/autotest_common.sh@107 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:07:37.616 17:55:46 -- common/autotest_common.sh@109 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:07:37.616 17:55:46 -- common/autotest_common.sh@111 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:07:37.616 17:55:46 -- common/autotest_common.sh@113 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:07:37.616 17:55:46 -- common/autotest_common.sh@115 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:07:37.616 17:55:46 -- common/autotest_common.sh@117 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:37.616 17:55:46 -- common/autotest_common.sh@119 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:07:37.616 17:55:46 -- common/autotest_common.sh@121 -- # : 1 00:07:37.616 17:55:46 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:07:37.616 17:55:46 -- common/autotest_common.sh@123 -- # : 00:07:37.616 17:55:46 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:37.616 17:55:46 -- common/autotest_common.sh@125 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:07:37.616 17:55:46 -- common/autotest_common.sh@127 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:07:37.616 17:55:46 -- common/autotest_common.sh@129 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:07:37.616 17:55:46 -- common/autotest_common.sh@131 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:07:37.616 17:55:46 -- common/autotest_common.sh@133 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:07:37.616 17:55:46 -- common/autotest_common.sh@135 -- # : 0 00:07:37.616 17:55:46 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:07:37.617 17:55:46 -- common/autotest_common.sh@137 -- # : 00:07:37.617 17:55:46 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:07:37.617 17:55:46 -- common/autotest_common.sh@139 -- # : true 00:07:37.617 17:55:46 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:07:37.617 17:55:46 -- common/autotest_common.sh@141 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:07:37.617 17:55:46 -- common/autotest_common.sh@143 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:07:37.617 17:55:46 -- common/autotest_common.sh@145 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:07:37.617 17:55:46 -- common/autotest_common.sh@147 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:07:37.617 17:55:46 -- common/autotest_common.sh@149 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:07:37.617 17:55:46 -- common/autotest_common.sh@151 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:07:37.617 17:55:46 -- common/autotest_common.sh@153 -- # : mlx5 00:07:37.617 17:55:46 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:07:37.617 17:55:46 -- common/autotest_common.sh@155 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:07:37.617 17:55:46 -- common/autotest_common.sh@157 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:07:37.617 17:55:46 -- common/autotest_common.sh@159 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:07:37.617 17:55:46 -- common/autotest_common.sh@161 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:07:37.617 17:55:46 -- common/autotest_common.sh@163 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:07:37.617 17:55:46 -- common/autotest_common.sh@166 -- # : 00:07:37.617 17:55:46 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:07:37.617 17:55:46 -- common/autotest_common.sh@168 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:07:37.617 17:55:46 -- common/autotest_common.sh@170 -- # : 0 00:07:37.617 17:55:46 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:37.617 17:55:46 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:37.617 17:55:46 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:37.617 17:55:46 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:07:37.617 17:55:46 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:37.617 17:55:46 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:07:37.617 17:55:46 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:37.617 17:55:46 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:37.617 17:55:46 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:37.617 17:55:46 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:37.617 17:55:46 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:37.617 17:55:46 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:07:37.617 17:55:46 -- common/autotest_common.sh@199 -- # cat 00:07:37.617 17:55:46 -- common/autotest_common.sh@235 -- # echo leak:libfuse3.so 00:07:37.617 17:55:46 -- common/autotest_common.sh@237 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:37.617 17:55:46 -- common/autotest_common.sh@237 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:37.617 17:55:46 -- common/autotest_common.sh@239 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:37.617 17:55:46 -- common/autotest_common.sh@239 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:37.617 17:55:46 -- common/autotest_common.sh@241 -- # '[' -z /var/spdk/dependencies ']' 00:07:37.617 17:55:46 -- common/autotest_common.sh@244 -- # export DEPENDENCY_DIR 00:07:37.617 17:55:46 -- common/autotest_common.sh@248 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:37.617 17:55:46 -- common/autotest_common.sh@248 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:07:37.617 17:55:46 -- common/autotest_common.sh@249 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:37.617 17:55:46 -- common/autotest_common.sh@249 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:07:37.617 17:55:46 -- common/autotest_common.sh@252 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:37.617 17:55:46 -- common/autotest_common.sh@252 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:37.617 17:55:46 -- common/autotest_common.sh@253 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:37.617 17:55:46 -- common/autotest_common.sh@253 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:37.617 17:55:46 -- common/autotest_common.sh@255 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:37.617 17:55:46 -- common/autotest_common.sh@255 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:37.617 17:55:46 -- common/autotest_common.sh@258 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@258 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@261 -- # '[' 0 -eq 0 ']' 00:07:37.617 17:55:46 -- common/autotest_common.sh@262 -- # export valgrind= 00:07:37.617 17:55:46 -- common/autotest_common.sh@262 -- # valgrind= 00:07:37.617 17:55:46 -- common/autotest_common.sh@268 -- # uname -s 00:07:37.617 17:55:46 -- common/autotest_common.sh@268 -- # '[' Linux = Linux ']' 00:07:37.617 17:55:46 -- common/autotest_common.sh@269 -- # HUGEMEM=4096 00:07:37.617 17:55:46 -- common/autotest_common.sh@270 -- # export CLEAR_HUGE=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@270 -- # CLEAR_HUGE=yes 00:07:37.617 17:55:46 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@278 -- # MAKE=make 00:07:37.618 17:55:46 -- common/autotest_common.sh@279 -- # MAKEFLAGS=-j72 00:07:37.618 17:55:46 -- common/autotest_common.sh@295 -- # export HUGEMEM=4096 00:07:37.618 17:55:46 -- common/autotest_common.sh@295 -- # HUGEMEM=4096 00:07:37.618 17:55:46 -- common/autotest_common.sh@297 -- # NO_HUGE=() 00:07:37.618 17:55:46 -- common/autotest_common.sh@298 -- # TEST_MODE= 00:07:37.618 17:55:46 -- common/autotest_common.sh@299 -- # for i in "$@" 00:07:37.618 17:55:46 -- common/autotest_common.sh@300 -- # case "$i" in 00:07:37.618 17:55:46 -- common/autotest_common.sh@305 -- # TEST_TRANSPORT=rdma 00:07:37.618 17:55:46 -- common/autotest_common.sh@317 -- # [[ -z 852961 ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@317 -- # kill -0 852961 00:07:37.618 17:55:46 -- common/autotest_common.sh@1676 -- # set_test_storage 2147483648 00:07:37.618 17:55:46 -- common/autotest_common.sh@327 -- # [[ -v testdir ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@329 -- # local requested_size=2147483648 00:07:37.618 17:55:46 -- common/autotest_common.sh@330 -- # local mount target_dir 00:07:37.618 17:55:46 -- common/autotest_common.sh@332 -- # local -A mounts fss sizes avails uses 00:07:37.618 17:55:46 -- common/autotest_common.sh@333 -- # local source fs size avail mount use 00:07:37.618 17:55:46 -- common/autotest_common.sh@335 -- # local storage_fallback storage_candidates 00:07:37.618 17:55:46 -- common/autotest_common.sh@337 -- # mktemp -udt spdk.XXXXXX 00:07:37.618 17:55:46 -- common/autotest_common.sh@337 -- # storage_fallback=/tmp/spdk.yBFHMC 00:07:37.618 17:55:46 -- common/autotest_common.sh@342 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:37.618 17:55:46 -- common/autotest_common.sh@344 -- # [[ -n '' ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@349 -- # [[ -n '' ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@354 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.yBFHMC/tests/target /tmp/spdk.yBFHMC 00:07:37.618 17:55:46 -- common/autotest_common.sh@357 -- # requested_size=2214592512 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@326 -- # df -T 00:07:37.618 17:55:46 -- common/autotest_common.sh@326 -- # grep -v Filesystem 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_devtmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=devtmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=67108864 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=67108864 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=0 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/pmem0 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=ext2 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=988676096 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=5284429824 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=4295753728 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_root 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=overlay 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=56396201984 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=61742698496 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=5346496512 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/sda1 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=xfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=221821267968 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=239938535424 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=18117267456 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=30870069248 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=30871347200 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=1277952 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=12339372032 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=12348542976 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=9170944 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=30871035904 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=30871351296 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=315392 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # avails["$mount"]=6174265344 00:07:37.618 17:55:46 -- common/autotest_common.sh@361 -- # sizes["$mount"]=6174269440 00:07:37.618 17:55:46 -- common/autotest_common.sh@362 -- # uses["$mount"]=4096 00:07:37.618 17:55:46 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:07:37.618 17:55:46 -- common/autotest_common.sh@365 -- # printf '* Looking for test storage...\n' 00:07:37.618 * Looking for test storage... 00:07:37.618 17:55:46 -- common/autotest_common.sh@367 -- # local target_space new_size 00:07:37.618 17:55:46 -- common/autotest_common.sh@368 -- # for target_dir in "${storage_candidates[@]}" 00:07:37.618 17:55:46 -- common/autotest_common.sh@371 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.618 17:55:46 -- common/autotest_common.sh@371 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:37.618 17:55:46 -- common/autotest_common.sh@371 -- # mount=/ 00:07:37.618 17:55:46 -- common/autotest_common.sh@373 -- # target_space=56396201984 00:07:37.618 17:55:46 -- common/autotest_common.sh@374 -- # (( target_space == 0 || target_space < requested_size )) 00:07:37.618 17:55:46 -- common/autotest_common.sh@377 -- # (( target_space >= requested_size )) 00:07:37.618 17:55:46 -- common/autotest_common.sh@379 -- # [[ overlay == tmpfs ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@379 -- # [[ overlay == ramfs ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@379 -- # [[ / == / ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@380 -- # new_size=7561089024 00:07:37.618 17:55:46 -- common/autotest_common.sh@381 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:37.618 17:55:46 -- common/autotest_common.sh@386 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.618 17:55:46 -- common/autotest_common.sh@386 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.618 17:55:46 -- common/autotest_common.sh@387 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.618 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:07:37.618 17:55:46 -- common/autotest_common.sh@388 -- # return 0 00:07:37.618 17:55:46 -- common/autotest_common.sh@1678 -- # set -o errtrace 00:07:37.618 17:55:46 -- common/autotest_common.sh@1679 -- # shopt -s extdebug 00:07:37.618 17:55:46 -- common/autotest_common.sh@1680 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:37.618 17:55:46 -- common/autotest_common.sh@1682 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:37.618 17:55:46 -- common/autotest_common.sh@1683 -- # true 00:07:37.618 17:55:46 -- common/autotest_common.sh@1685 -- # xtrace_fd 00:07:37.618 17:55:46 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:37.618 17:55:46 -- common/autotest_common.sh@27 -- # exec 00:07:37.618 17:55:46 -- common/autotest_common.sh@29 -- # exec 00:07:37.618 17:55:46 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:37.618 17:55:46 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:37.619 17:55:46 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:37.619 17:55:46 -- common/autotest_common.sh@18 -- # set -x 00:07:37.619 17:55:46 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:07:37.619 17:55:46 -- nvmf/common.sh@7 -- # uname -s 00:07:37.619 17:55:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:37.619 17:55:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:37.619 17:55:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:37.619 17:55:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:37.619 17:55:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:37.619 17:55:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:37.619 17:55:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:37.619 17:55:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:37.619 17:55:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:37.619 17:55:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:37.619 17:55:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:07:37.619 17:55:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:07:37.619 17:55:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:37.619 17:55:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:37.619 17:55:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:37.619 17:55:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:07:37.619 17:55:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:07:37.619 17:55:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:37.619 17:55:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:37.619 17:55:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:37.619 17:55:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.619 17:55:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.619 17:55:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.619 17:55:46 -- paths/export.sh@5 -- # export PATH 00:07:37.619 17:55:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:37.619 17:55:46 -- nvmf/common.sh@47 -- # : 0 00:07:37.619 17:55:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:07:37.619 17:55:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:07:37.619 17:55:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:07:37.619 17:55:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:37.619 17:55:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:37.619 17:55:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:07:37.619 17:55:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:07:37.619 17:55:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:07:37.619 17:55:46 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:37.619 17:55:46 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:37.619 17:55:46 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:37.619 17:55:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:07:37.619 17:55:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:37.619 17:55:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:07:37.619 17:55:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:07:37.619 17:55:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:07:37.619 17:55:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.619 17:55:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.619 17:55:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:37.619 17:55:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:07:37.619 17:55:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:07:37.619 17:55:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:07:37.619 17:55:46 -- common/autotest_common.sh@10 -- # set +x 00:07:44.190 17:55:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:44.190 17:55:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:07:44.190 17:55:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:07:44.190 17:55:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:07:44.190 17:55:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:07:44.190 17:55:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:07:44.190 17:55:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:07:44.190 17:55:52 -- nvmf/common.sh@295 -- # net_devs=() 00:07:44.190 17:55:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:07:44.190 17:55:52 -- nvmf/common.sh@296 -- # e810=() 00:07:44.190 17:55:52 -- nvmf/common.sh@296 -- # local -ga e810 00:07:44.190 17:55:52 -- nvmf/common.sh@297 -- # x722=() 00:07:44.190 17:55:52 -- nvmf/common.sh@297 -- # local -ga x722 00:07:44.190 17:55:52 -- nvmf/common.sh@298 -- # mlx=() 00:07:44.190 17:55:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:07:44.190 17:55:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:44.190 17:55:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:07:44.190 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:07:44.190 17:55:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:44.190 17:55:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:07:44.190 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:07:44.190 17:55:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:07:44.190 17:55:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.190 17:55:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.190 17:55:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:07:44.190 Found net devices under 0000:18:00.0: mlx_0_0 00:07:44.190 17:55:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:44.190 17:55:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:44.190 17:55:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:07:44.190 Found net devices under 0000:18:00.1: mlx_0_1 00:07:44.190 17:55:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:07:44.190 17:55:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:07:44.190 17:55:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:07:44.190 17:55:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:07:44.190 17:55:52 -- nvmf/common.sh@58 -- # uname 00:07:44.190 17:55:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:07:44.190 17:55:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:07:44.190 17:55:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:07:44.190 17:55:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:07:44.190 17:55:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:07:44.190 17:55:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:07:44.190 17:55:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:07:44.190 17:55:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:07:44.190 17:55:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:07:44.190 17:55:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:07:44.190 17:55:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:07:44.190 17:55:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:44.190 17:55:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:44.190 17:55:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:44.190 17:55:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:44.190 17:55:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:44.190 17:55:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:44.190 17:55:52 -- nvmf/common.sh@105 -- # continue 2 00:07:44.190 17:55:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.190 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:44.190 17:55:52 -- nvmf/common.sh@105 -- # continue 2 00:07:44.190 17:55:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:44.190 17:55:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:07:44.190 17:55:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:44.190 17:55:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:07:44.190 17:55:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:07:44.190 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:44.190 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:07:44.190 altname enp24s0f0np0 00:07:44.190 altname ens785f0np0 00:07:44.190 inet 192.168.100.8/24 scope global mlx_0_0 00:07:44.190 valid_lft forever preferred_lft forever 00:07:44.190 17:55:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:07:44.190 17:55:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:07:44.190 17:55:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:44.190 17:55:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:44.190 17:55:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:07:44.190 17:55:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:07:44.190 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:07:44.190 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:07:44.190 altname enp24s0f1np1 00:07:44.190 altname ens785f1np1 00:07:44.190 inet 192.168.100.9/24 scope global mlx_0_1 00:07:44.190 valid_lft forever preferred_lft forever 00:07:44.190 17:55:52 -- nvmf/common.sh@411 -- # return 0 00:07:44.190 17:55:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:07:44.190 17:55:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:07:44.190 17:55:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:07:44.190 17:55:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:07:44.190 17:55:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:07:44.190 17:55:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:07:44.191 17:55:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:07:44.191 17:55:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:07:44.191 17:55:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:07:44.191 17:55:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:07:44.191 17:55:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:44.191 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.191 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:07:44.191 17:55:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:07:44.191 17:55:52 -- nvmf/common.sh@105 -- # continue 2 00:07:44.191 17:55:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:07:44.191 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.191 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:07:44.191 17:55:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:07:44.191 17:55:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:07:44.191 17:55:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:07:44.191 17:55:52 -- nvmf/common.sh@105 -- # continue 2 00:07:44.191 17:55:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:44.191 17:55:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:07:44.191 17:55:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:44.191 17:55:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:07:44.191 17:55:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:07:44.191 17:55:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:07:44.191 17:55:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:07:44.191 17:55:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:07:44.191 192.168.100.9' 00:07:44.191 17:55:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:07:44.191 192.168.100.9' 00:07:44.191 17:55:52 -- nvmf/common.sh@446 -- # head -n 1 00:07:44.191 17:55:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:07:44.191 17:55:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:07:44.191 192.168.100.9' 00:07:44.191 17:55:52 -- nvmf/common.sh@447 -- # tail -n +2 00:07:44.191 17:55:52 -- nvmf/common.sh@447 -- # head -n 1 00:07:44.191 17:55:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:07:44.191 17:55:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:07:44.191 17:55:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:07:44.191 17:55:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:07:44.191 17:55:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:07:44.191 17:55:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:07:44.191 17:55:52 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:44.191 17:55:52 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:44.191 17:55:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:44.191 17:55:52 -- common/autotest_common.sh@10 -- # set +x 00:07:44.191 ************************************ 00:07:44.191 START TEST nvmf_filesystem_no_in_capsule 00:07:44.191 ************************************ 00:07:44.191 17:55:52 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_part 0 00:07:44.191 17:55:52 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:44.191 17:55:52 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:44.191 17:55:52 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:44.191 17:55:52 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:44.191 17:55:52 -- common/autotest_common.sh@10 -- # set +x 00:07:44.191 17:55:52 -- nvmf/common.sh@470 -- # nvmfpid=855847 00:07:44.191 17:55:52 -- nvmf/common.sh@471 -- # waitforlisten 855847 00:07:44.191 17:55:52 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:44.191 17:55:52 -- common/autotest_common.sh@827 -- # '[' -z 855847 ']' 00:07:44.191 17:55:52 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:44.191 17:55:52 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:44.191 17:55:52 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:44.191 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:44.191 17:55:52 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:44.191 17:55:52 -- common/autotest_common.sh@10 -- # set +x 00:07:44.191 [2024-04-26 17:55:52.950595] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:44.191 [2024-04-26 17:55:52.950652] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:44.191 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.191 [2024-04-26 17:55:53.023160] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:44.191 [2024-04-26 17:55:53.110529] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:44.191 [2024-04-26 17:55:53.110590] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:44.191 [2024-04-26 17:55:53.110602] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:44.191 [2024-04-26 17:55:53.110626] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:44.191 [2024-04-26 17:55:53.110634] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:44.191 [2024-04-26 17:55:53.110686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:44.191 [2024-04-26 17:55:53.110770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:44.191 [2024-04-26 17:55:53.110838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:44.191 [2024-04-26 17:55:53.110839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:44.758 17:55:53 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:44.758 17:55:53 -- common/autotest_common.sh@860 -- # return 0 00:07:44.758 17:55:53 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:44.758 17:55:53 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:44.758 17:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:44.758 17:55:53 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:44.758 17:55:53 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:44.758 17:55:53 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:07:44.758 17:55:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:44.758 17:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:44.758 [2024-04-26 17:55:53.816364] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:07:44.758 [2024-04-26 17:55:53.838073] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x14e34d0/0x14e79c0) succeed. 00:07:44.758 [2024-04-26 17:55:53.848388] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14e4b10/0x1529050) succeed. 00:07:44.758 17:55:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:44.758 17:55:53 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:44.758 17:55:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:44.758 17:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:45.017 Malloc1 00:07:45.017 17:55:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:45.017 17:55:54 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:45.017 17:55:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:45.017 17:55:54 -- common/autotest_common.sh@10 -- # set +x 00:07:45.017 17:55:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:45.017 17:55:54 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:45.017 17:55:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:45.017 17:55:54 -- common/autotest_common.sh@10 -- # set +x 00:07:45.017 17:55:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:45.017 17:55:54 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:45.017 17:55:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:45.017 17:55:54 -- common/autotest_common.sh@10 -- # set +x 00:07:45.017 [2024-04-26 17:55:54.108350] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:45.017 17:55:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:45.017 17:55:54 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:45.017 17:55:54 -- common/autotest_common.sh@1374 -- # local bdev_name=Malloc1 00:07:45.017 17:55:54 -- common/autotest_common.sh@1375 -- # local bdev_info 00:07:45.017 17:55:54 -- common/autotest_common.sh@1376 -- # local bs 00:07:45.017 17:55:54 -- common/autotest_common.sh@1377 -- # local nb 00:07:45.017 17:55:54 -- common/autotest_common.sh@1378 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:45.017 17:55:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:45.017 17:55:54 -- common/autotest_common.sh@10 -- # set +x 00:07:45.017 17:55:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:45.017 17:55:54 -- common/autotest_common.sh@1378 -- # bdev_info='[ 00:07:45.017 { 00:07:45.017 "name": "Malloc1", 00:07:45.017 "aliases": [ 00:07:45.017 "1ac0ce47-5ab2-49b4-9db2-1bf7fa4fc3fd" 00:07:45.017 ], 00:07:45.017 "product_name": "Malloc disk", 00:07:45.017 "block_size": 512, 00:07:45.017 "num_blocks": 1048576, 00:07:45.017 "uuid": "1ac0ce47-5ab2-49b4-9db2-1bf7fa4fc3fd", 00:07:45.017 "assigned_rate_limits": { 00:07:45.017 "rw_ios_per_sec": 0, 00:07:45.017 "rw_mbytes_per_sec": 0, 00:07:45.017 "r_mbytes_per_sec": 0, 00:07:45.017 "w_mbytes_per_sec": 0 00:07:45.017 }, 00:07:45.017 "claimed": true, 00:07:45.017 "claim_type": "exclusive_write", 00:07:45.017 "zoned": false, 00:07:45.017 "supported_io_types": { 00:07:45.017 "read": true, 00:07:45.017 "write": true, 00:07:45.017 "unmap": true, 00:07:45.017 "write_zeroes": true, 00:07:45.017 "flush": true, 00:07:45.017 "reset": true, 00:07:45.017 "compare": false, 00:07:45.017 "compare_and_write": false, 00:07:45.017 "abort": true, 00:07:45.017 "nvme_admin": false, 00:07:45.017 "nvme_io": false 00:07:45.017 }, 00:07:45.017 "memory_domains": [ 00:07:45.017 { 00:07:45.017 "dma_device_id": "system", 00:07:45.017 "dma_device_type": 1 00:07:45.017 }, 00:07:45.017 { 00:07:45.017 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:45.017 "dma_device_type": 2 00:07:45.017 } 00:07:45.017 ], 00:07:45.017 "driver_specific": {} 00:07:45.017 } 00:07:45.017 ]' 00:07:45.017 17:55:54 -- common/autotest_common.sh@1379 -- # jq '.[] .block_size' 00:07:45.017 17:55:54 -- common/autotest_common.sh@1379 -- # bs=512 00:07:45.017 17:55:54 -- common/autotest_common.sh@1380 -- # jq '.[] .num_blocks' 00:07:45.276 17:55:54 -- common/autotest_common.sh@1380 -- # nb=1048576 00:07:45.276 17:55:54 -- common/autotest_common.sh@1383 -- # bdev_size=512 00:07:45.276 17:55:54 -- common/autotest_common.sh@1384 -- # echo 512 00:07:45.276 17:55:54 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:45.276 17:55:54 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:46.211 17:55:55 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:46.212 17:55:55 -- common/autotest_common.sh@1194 -- # local i=0 00:07:46.212 17:55:55 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:07:46.212 17:55:55 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:07:46.212 17:55:55 -- common/autotest_common.sh@1201 -- # sleep 2 00:07:48.148 17:55:57 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:07:48.148 17:55:57 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:07:48.148 17:55:57 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:07:48.148 17:55:57 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:07:48.148 17:55:57 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:07:48.148 17:55:57 -- common/autotest_common.sh@1204 -- # return 0 00:07:48.148 17:55:57 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:48.148 17:55:57 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:48.148 17:55:57 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:48.148 17:55:57 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:48.148 17:55:57 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:48.148 17:55:57 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:48.148 17:55:57 -- setup/common.sh@80 -- # echo 536870912 00:07:48.148 17:55:57 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:48.148 17:55:57 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:48.148 17:55:57 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:48.148 17:55:57 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:48.148 17:55:57 -- target/filesystem.sh@69 -- # partprobe 00:07:48.407 17:55:57 -- target/filesystem.sh@70 -- # sleep 1 00:07:49.344 17:55:58 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:49.344 17:55:58 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:49.344 17:55:58 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:49.344 17:55:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:49.344 17:55:58 -- common/autotest_common.sh@10 -- # set +x 00:07:49.602 ************************************ 00:07:49.602 START TEST filesystem_ext4 00:07:49.602 ************************************ 00:07:49.602 17:55:58 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:49.602 17:55:58 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:49.602 17:55:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:49.602 17:55:58 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:49.602 17:55:58 -- common/autotest_common.sh@922 -- # local fstype=ext4 00:07:49.602 17:55:58 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:49.602 17:55:58 -- common/autotest_common.sh@924 -- # local i=0 00:07:49.602 17:55:58 -- common/autotest_common.sh@925 -- # local force 00:07:49.602 17:55:58 -- common/autotest_common.sh@927 -- # '[' ext4 = ext4 ']' 00:07:49.602 17:55:58 -- common/autotest_common.sh@928 -- # force=-F 00:07:49.602 17:55:58 -- common/autotest_common.sh@933 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:49.602 mke2fs 1.46.5 (30-Dec-2021) 00:07:49.602 Discarding device blocks: 0/522240 done 00:07:49.602 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:49.602 Filesystem UUID: 71c2c3c8-c3f5-4087-af0b-8387bd60dfe6 00:07:49.602 Superblock backups stored on blocks: 00:07:49.602 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:49.602 00:07:49.602 Allocating group tables: 0/64 done 00:07:49.602 Writing inode tables: 0/64 done 00:07:49.602 Creating journal (8192 blocks): done 00:07:49.602 Writing superblocks and filesystem accounting information: 0/64 done 00:07:49.602 00:07:49.602 17:55:58 -- common/autotest_common.sh@941 -- # return 0 00:07:49.602 17:55:58 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:49.602 17:55:58 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:49.602 17:55:58 -- target/filesystem.sh@25 -- # sync 00:07:49.602 17:55:58 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:49.602 17:55:58 -- target/filesystem.sh@27 -- # sync 00:07:49.602 17:55:58 -- target/filesystem.sh@29 -- # i=0 00:07:49.602 17:55:58 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:49.861 17:55:58 -- target/filesystem.sh@37 -- # kill -0 855847 00:07:49.861 17:55:58 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:49.861 17:55:58 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:49.861 17:55:58 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:49.861 17:55:58 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:49.861 00:07:49.861 real 0m0.200s 00:07:49.861 user 0m0.030s 00:07:49.861 sys 0m0.073s 00:07:49.861 17:55:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:49.861 17:55:58 -- common/autotest_common.sh@10 -- # set +x 00:07:49.861 ************************************ 00:07:49.861 END TEST filesystem_ext4 00:07:49.861 ************************************ 00:07:49.861 17:55:58 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:49.861 17:55:58 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:49.861 17:55:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:49.861 17:55:58 -- common/autotest_common.sh@10 -- # set +x 00:07:49.861 ************************************ 00:07:49.861 START TEST filesystem_btrfs 00:07:49.861 ************************************ 00:07:49.861 17:55:59 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:49.861 17:55:59 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:49.861 17:55:59 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:49.861 17:55:59 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:49.861 17:55:59 -- common/autotest_common.sh@922 -- # local fstype=btrfs 00:07:49.861 17:55:59 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:49.861 17:55:59 -- common/autotest_common.sh@924 -- # local i=0 00:07:49.861 17:55:59 -- common/autotest_common.sh@925 -- # local force 00:07:49.861 17:55:59 -- common/autotest_common.sh@927 -- # '[' btrfs = ext4 ']' 00:07:49.861 17:55:59 -- common/autotest_common.sh@930 -- # force=-f 00:07:49.861 17:55:59 -- common/autotest_common.sh@933 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:50.120 btrfs-progs v6.6.2 00:07:50.120 See https://btrfs.readthedocs.io for more information. 00:07:50.120 00:07:50.120 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:50.120 NOTE: several default settings have changed in version 5.15, please make sure 00:07:50.120 this does not affect your deployments: 00:07:50.120 - DUP for metadata (-m dup) 00:07:50.120 - enabled no-holes (-O no-holes) 00:07:50.120 - enabled free-space-tree (-R free-space-tree) 00:07:50.120 00:07:50.120 Label: (null) 00:07:50.120 UUID: e6315797-fb68-4471-b198-7209d6fc388c 00:07:50.120 Node size: 16384 00:07:50.120 Sector size: 4096 00:07:50.120 Filesystem size: 510.00MiB 00:07:50.120 Block group profiles: 00:07:50.120 Data: single 8.00MiB 00:07:50.120 Metadata: DUP 32.00MiB 00:07:50.120 System: DUP 8.00MiB 00:07:50.120 SSD detected: yes 00:07:50.120 Zoned device: no 00:07:50.120 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:50.120 Runtime features: free-space-tree 00:07:50.120 Checksum: crc32c 00:07:50.120 Number of devices: 1 00:07:50.120 Devices: 00:07:50.121 ID SIZE PATH 00:07:50.121 1 510.00MiB /dev/nvme0n1p1 00:07:50.121 00:07:50.121 17:55:59 -- common/autotest_common.sh@941 -- # return 0 00:07:50.121 17:55:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:50.121 17:55:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:50.121 17:55:59 -- target/filesystem.sh@25 -- # sync 00:07:50.121 17:55:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:50.121 17:55:59 -- target/filesystem.sh@27 -- # sync 00:07:50.121 17:55:59 -- target/filesystem.sh@29 -- # i=0 00:07:50.121 17:55:59 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:50.121 17:55:59 -- target/filesystem.sh@37 -- # kill -0 855847 00:07:50.121 17:55:59 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:50.121 17:55:59 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:50.121 17:55:59 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:50.121 17:55:59 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:50.121 00:07:50.121 real 0m0.267s 00:07:50.121 user 0m0.029s 00:07:50.121 sys 0m0.139s 00:07:50.121 17:55:59 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:50.121 17:55:59 -- common/autotest_common.sh@10 -- # set +x 00:07:50.121 ************************************ 00:07:50.121 END TEST filesystem_btrfs 00:07:50.121 ************************************ 00:07:50.379 17:55:59 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:50.379 17:55:59 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:50.379 17:55:59 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:50.379 17:55:59 -- common/autotest_common.sh@10 -- # set +x 00:07:50.379 ************************************ 00:07:50.379 START TEST filesystem_xfs 00:07:50.379 ************************************ 00:07:50.379 17:55:59 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create xfs nvme0n1 00:07:50.379 17:55:59 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:50.379 17:55:59 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:50.379 17:55:59 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:50.379 17:55:59 -- common/autotest_common.sh@922 -- # local fstype=xfs 00:07:50.379 17:55:59 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:50.379 17:55:59 -- common/autotest_common.sh@924 -- # local i=0 00:07:50.379 17:55:59 -- common/autotest_common.sh@925 -- # local force 00:07:50.379 17:55:59 -- common/autotest_common.sh@927 -- # '[' xfs = ext4 ']' 00:07:50.379 17:55:59 -- common/autotest_common.sh@930 -- # force=-f 00:07:50.379 17:55:59 -- common/autotest_common.sh@933 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:50.677 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:50.677 = sectsz=512 attr=2, projid32bit=1 00:07:50.677 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:50.677 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:50.677 data = bsize=4096 blocks=130560, imaxpct=25 00:07:50.677 = sunit=0 swidth=0 blks 00:07:50.677 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:50.677 log =internal log bsize=4096 blocks=16384, version=2 00:07:50.677 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:50.677 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:50.677 Discarding blocks...Done. 00:07:50.677 17:55:59 -- common/autotest_common.sh@941 -- # return 0 00:07:50.677 17:55:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:50.677 17:55:59 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:50.677 17:55:59 -- target/filesystem.sh@25 -- # sync 00:07:50.677 17:55:59 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:50.677 17:55:59 -- target/filesystem.sh@27 -- # sync 00:07:50.677 17:55:59 -- target/filesystem.sh@29 -- # i=0 00:07:50.677 17:55:59 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:50.677 17:55:59 -- target/filesystem.sh@37 -- # kill -0 855847 00:07:50.677 17:55:59 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:50.677 17:55:59 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:50.677 17:55:59 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:50.677 17:55:59 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:50.677 00:07:50.677 real 0m0.212s 00:07:50.677 user 0m0.028s 00:07:50.677 sys 0m0.082s 00:07:50.677 17:55:59 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:50.677 17:55:59 -- common/autotest_common.sh@10 -- # set +x 00:07:50.677 ************************************ 00:07:50.677 END TEST filesystem_xfs 00:07:50.677 ************************************ 00:07:50.677 17:55:59 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:50.677 17:55:59 -- target/filesystem.sh@93 -- # sync 00:07:50.677 17:55:59 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:51.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:51.612 17:56:00 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:51.612 17:56:00 -- common/autotest_common.sh@1215 -- # local i=0 00:07:51.612 17:56:00 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:07:51.612 17:56:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:51.871 17:56:00 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:07:51.871 17:56:00 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:51.871 17:56:00 -- common/autotest_common.sh@1227 -- # return 0 00:07:51.871 17:56:00 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:51.871 17:56:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:51.871 17:56:00 -- common/autotest_common.sh@10 -- # set +x 00:07:51.871 17:56:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:51.871 17:56:00 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:51.871 17:56:00 -- target/filesystem.sh@101 -- # killprocess 855847 00:07:51.871 17:56:00 -- common/autotest_common.sh@946 -- # '[' -z 855847 ']' 00:07:51.871 17:56:00 -- common/autotest_common.sh@950 -- # kill -0 855847 00:07:51.871 17:56:00 -- common/autotest_common.sh@951 -- # uname 00:07:51.871 17:56:00 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:07:51.871 17:56:00 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 855847 00:07:51.871 17:56:00 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:07:51.871 17:56:00 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:07:51.871 17:56:00 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 855847' 00:07:51.871 killing process with pid 855847 00:07:51.871 17:56:00 -- common/autotest_common.sh@965 -- # kill 855847 00:07:51.871 17:56:00 -- common/autotest_common.sh@970 -- # wait 855847 00:07:51.871 [2024-04-26 17:56:00.948943] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:07:52.438 17:56:01 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:52.438 00:07:52.438 real 0m8.471s 00:07:52.438 user 0m33.037s 00:07:52.438 sys 0m1.458s 00:07:52.438 17:56:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:52.438 17:56:01 -- common/autotest_common.sh@10 -- # set +x 00:07:52.438 ************************************ 00:07:52.438 END TEST nvmf_filesystem_no_in_capsule 00:07:52.438 ************************************ 00:07:52.438 17:56:01 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:52.438 17:56:01 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:07:52.438 17:56:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:52.438 17:56:01 -- common/autotest_common.sh@10 -- # set +x 00:07:52.438 ************************************ 00:07:52.438 START TEST nvmf_filesystem_in_capsule 00:07:52.438 ************************************ 00:07:52.438 17:56:01 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_part 4096 00:07:52.438 17:56:01 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:52.438 17:56:01 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:52.438 17:56:01 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:07:52.438 17:56:01 -- common/autotest_common.sh@720 -- # xtrace_disable 00:07:52.438 17:56:01 -- common/autotest_common.sh@10 -- # set +x 00:07:52.438 17:56:01 -- nvmf/common.sh@470 -- # nvmfpid=857197 00:07:52.438 17:56:01 -- nvmf/common.sh@471 -- # waitforlisten 857197 00:07:52.438 17:56:01 -- common/autotest_common.sh@827 -- # '[' -z 857197 ']' 00:07:52.438 17:56:01 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:52.438 17:56:01 -- common/autotest_common.sh@832 -- # local max_retries=100 00:07:52.438 17:56:01 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:52.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:52.438 17:56:01 -- common/autotest_common.sh@836 -- # xtrace_disable 00:07:52.438 17:56:01 -- common/autotest_common.sh@10 -- # set +x 00:07:52.438 17:56:01 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:52.438 [2024-04-26 17:56:01.609173] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:07:52.438 [2024-04-26 17:56:01.609224] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:52.697 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.697 [2024-04-26 17:56:01.681312] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:52.697 [2024-04-26 17:56:01.769918] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:52.697 [2024-04-26 17:56:01.769961] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:52.697 [2024-04-26 17:56:01.769974] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:07:52.697 [2024-04-26 17:56:01.769983] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:07:52.697 [2024-04-26 17:56:01.769989] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:52.697 [2024-04-26 17:56:01.770078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:52.697 [2024-04-26 17:56:01.770178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:52.697 [2024-04-26 17:56:01.770259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:52.697 [2024-04-26 17:56:01.770260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:53.265 17:56:02 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:07:53.265 17:56:02 -- common/autotest_common.sh@860 -- # return 0 00:07:53.265 17:56:02 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:07:53.265 17:56:02 -- common/autotest_common.sh@726 -- # xtrace_disable 00:07:53.265 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.524 17:56:02 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:53.524 17:56:02 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:53.524 17:56:02 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 4096 00:07:53.524 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.524 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.524 [2024-04-26 17:56:02.505450] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1ea54d0/0x1ea99c0) succeed. 00:07:53.524 [2024-04-26 17:56:02.516052] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1ea6b10/0x1eeb050) succeed. 00:07:53.524 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.524 17:56:02 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:53.524 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.524 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.783 Malloc1 00:07:53.783 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.783 17:56:02 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:53.783 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.783 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.783 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.783 17:56:02 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:53.783 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.783 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.783 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.783 17:56:02 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:07:53.783 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.783 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.783 [2024-04-26 17:56:02.802492] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:07:53.783 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.783 17:56:02 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:53.783 17:56:02 -- common/autotest_common.sh@1374 -- # local bdev_name=Malloc1 00:07:53.783 17:56:02 -- common/autotest_common.sh@1375 -- # local bdev_info 00:07:53.783 17:56:02 -- common/autotest_common.sh@1376 -- # local bs 00:07:53.783 17:56:02 -- common/autotest_common.sh@1377 -- # local nb 00:07:53.783 17:56:02 -- common/autotest_common.sh@1378 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:53.783 17:56:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:07:53.783 17:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:53.783 17:56:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:07:53.783 17:56:02 -- common/autotest_common.sh@1378 -- # bdev_info='[ 00:07:53.783 { 00:07:53.783 "name": "Malloc1", 00:07:53.783 "aliases": [ 00:07:53.783 "dcd015f4-ccb1-4b5b-b497-48bcc33ea273" 00:07:53.783 ], 00:07:53.783 "product_name": "Malloc disk", 00:07:53.783 "block_size": 512, 00:07:53.783 "num_blocks": 1048576, 00:07:53.783 "uuid": "dcd015f4-ccb1-4b5b-b497-48bcc33ea273", 00:07:53.783 "assigned_rate_limits": { 00:07:53.783 "rw_ios_per_sec": 0, 00:07:53.783 "rw_mbytes_per_sec": 0, 00:07:53.783 "r_mbytes_per_sec": 0, 00:07:53.783 "w_mbytes_per_sec": 0 00:07:53.783 }, 00:07:53.783 "claimed": true, 00:07:53.783 "claim_type": "exclusive_write", 00:07:53.783 "zoned": false, 00:07:53.783 "supported_io_types": { 00:07:53.783 "read": true, 00:07:53.783 "write": true, 00:07:53.783 "unmap": true, 00:07:53.783 "write_zeroes": true, 00:07:53.783 "flush": true, 00:07:53.783 "reset": true, 00:07:53.783 "compare": false, 00:07:53.783 "compare_and_write": false, 00:07:53.783 "abort": true, 00:07:53.783 "nvme_admin": false, 00:07:53.783 "nvme_io": false 00:07:53.783 }, 00:07:53.783 "memory_domains": [ 00:07:53.783 { 00:07:53.783 "dma_device_id": "system", 00:07:53.783 "dma_device_type": 1 00:07:53.783 }, 00:07:53.783 { 00:07:53.783 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:53.783 "dma_device_type": 2 00:07:53.783 } 00:07:53.783 ], 00:07:53.783 "driver_specific": {} 00:07:53.783 } 00:07:53.783 ]' 00:07:53.783 17:56:02 -- common/autotest_common.sh@1379 -- # jq '.[] .block_size' 00:07:53.783 17:56:02 -- common/autotest_common.sh@1379 -- # bs=512 00:07:53.783 17:56:02 -- common/autotest_common.sh@1380 -- # jq '.[] .num_blocks' 00:07:53.783 17:56:02 -- common/autotest_common.sh@1380 -- # nb=1048576 00:07:53.783 17:56:02 -- common/autotest_common.sh@1383 -- # bdev_size=512 00:07:53.783 17:56:02 -- common/autotest_common.sh@1384 -- # echo 512 00:07:53.783 17:56:02 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:53.783 17:56:02 -- target/filesystem.sh@60 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:07:54.718 17:56:03 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:54.718 17:56:03 -- common/autotest_common.sh@1194 -- # local i=0 00:07:54.718 17:56:03 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:07:54.718 17:56:03 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:07:54.718 17:56:03 -- common/autotest_common.sh@1201 -- # sleep 2 00:07:57.250 17:56:05 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:07:57.250 17:56:05 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:07:57.250 17:56:05 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:07:57.250 17:56:05 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:07:57.250 17:56:05 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:07:57.250 17:56:05 -- common/autotest_common.sh@1204 -- # return 0 00:07:57.250 17:56:05 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:57.250 17:56:05 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:57.250 17:56:05 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:57.250 17:56:05 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:57.250 17:56:05 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:57.250 17:56:05 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:57.250 17:56:05 -- setup/common.sh@80 -- # echo 536870912 00:07:57.250 17:56:05 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:57.250 17:56:05 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:57.250 17:56:05 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:57.250 17:56:05 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:57.250 17:56:05 -- target/filesystem.sh@69 -- # partprobe 00:07:57.250 17:56:06 -- target/filesystem.sh@70 -- # sleep 1 00:07:58.187 17:56:07 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:58.187 17:56:07 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:58.187 17:56:07 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:58.187 17:56:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:58.187 17:56:07 -- common/autotest_common.sh@10 -- # set +x 00:07:58.187 ************************************ 00:07:58.187 START TEST filesystem_in_capsule_ext4 00:07:58.187 ************************************ 00:07:58.187 17:56:07 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:58.187 17:56:07 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:58.187 17:56:07 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:58.187 17:56:07 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:58.187 17:56:07 -- common/autotest_common.sh@922 -- # local fstype=ext4 00:07:58.187 17:56:07 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:58.187 17:56:07 -- common/autotest_common.sh@924 -- # local i=0 00:07:58.187 17:56:07 -- common/autotest_common.sh@925 -- # local force 00:07:58.187 17:56:07 -- common/autotest_common.sh@927 -- # '[' ext4 = ext4 ']' 00:07:58.187 17:56:07 -- common/autotest_common.sh@928 -- # force=-F 00:07:58.187 17:56:07 -- common/autotest_common.sh@933 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:58.187 mke2fs 1.46.5 (30-Dec-2021) 00:07:58.446 Discarding device blocks: 0/522240 done 00:07:58.446 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:58.446 Filesystem UUID: 50e00779-2f01-4ac7-b9e7-5ad5c120941e 00:07:58.446 Superblock backups stored on blocks: 00:07:58.446 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:58.446 00:07:58.446 Allocating group tables: 0/64 done 00:07:58.446 Writing inode tables: 0/64 done 00:07:58.446 Creating journal (8192 blocks): done 00:07:58.446 Writing superblocks and filesystem accounting information: 0/64 done 00:07:58.446 00:07:58.446 17:56:07 -- common/autotest_common.sh@941 -- # return 0 00:07:58.446 17:56:07 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:58.446 17:56:07 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:58.446 17:56:07 -- target/filesystem.sh@25 -- # sync 00:07:58.446 17:56:07 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:58.446 17:56:07 -- target/filesystem.sh@27 -- # sync 00:07:58.446 17:56:07 -- target/filesystem.sh@29 -- # i=0 00:07:58.446 17:56:07 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:58.446 17:56:07 -- target/filesystem.sh@37 -- # kill -0 857197 00:07:58.446 17:56:07 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:58.446 17:56:07 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:58.446 17:56:07 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:58.446 17:56:07 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:58.446 00:07:58.446 real 0m0.197s 00:07:58.446 user 0m0.020s 00:07:58.446 sys 0m0.078s 00:07:58.446 17:56:07 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:58.446 17:56:07 -- common/autotest_common.sh@10 -- # set +x 00:07:58.446 ************************************ 00:07:58.446 END TEST filesystem_in_capsule_ext4 00:07:58.446 ************************************ 00:07:58.446 17:56:07 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:58.446 17:56:07 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:58.446 17:56:07 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:58.446 17:56:07 -- common/autotest_common.sh@10 -- # set +x 00:07:58.705 ************************************ 00:07:58.705 START TEST filesystem_in_capsule_btrfs 00:07:58.705 ************************************ 00:07:58.705 17:56:07 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:58.705 17:56:07 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:58.705 17:56:07 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:58.705 17:56:07 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:58.705 17:56:07 -- common/autotest_common.sh@922 -- # local fstype=btrfs 00:07:58.705 17:56:07 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:58.705 17:56:07 -- common/autotest_common.sh@924 -- # local i=0 00:07:58.705 17:56:07 -- common/autotest_common.sh@925 -- # local force 00:07:58.705 17:56:07 -- common/autotest_common.sh@927 -- # '[' btrfs = ext4 ']' 00:07:58.705 17:56:07 -- common/autotest_common.sh@930 -- # force=-f 00:07:58.705 17:56:07 -- common/autotest_common.sh@933 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:58.705 btrfs-progs v6.6.2 00:07:58.705 See https://btrfs.readthedocs.io for more information. 00:07:58.705 00:07:58.705 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:58.705 NOTE: several default settings have changed in version 5.15, please make sure 00:07:58.705 this does not affect your deployments: 00:07:58.705 - DUP for metadata (-m dup) 00:07:58.705 - enabled no-holes (-O no-holes) 00:07:58.705 - enabled free-space-tree (-R free-space-tree) 00:07:58.705 00:07:58.705 Label: (null) 00:07:58.705 UUID: cfa552ea-1f7e-4021-88f0-cc35a4c653d6 00:07:58.705 Node size: 16384 00:07:58.705 Sector size: 4096 00:07:58.705 Filesystem size: 510.00MiB 00:07:58.705 Block group profiles: 00:07:58.705 Data: single 8.00MiB 00:07:58.705 Metadata: DUP 32.00MiB 00:07:58.705 System: DUP 8.00MiB 00:07:58.705 SSD detected: yes 00:07:58.705 Zoned device: no 00:07:58.705 Incompat features: extref, skinny-metadata, no-holes, free-space-tree 00:07:58.705 Runtime features: free-space-tree 00:07:58.705 Checksum: crc32c 00:07:58.705 Number of devices: 1 00:07:58.705 Devices: 00:07:58.705 ID SIZE PATH 00:07:58.705 1 510.00MiB /dev/nvme0n1p1 00:07:58.705 00:07:58.705 17:56:07 -- common/autotest_common.sh@941 -- # return 0 00:07:58.705 17:56:07 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:58.964 17:56:07 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:58.964 17:56:07 -- target/filesystem.sh@25 -- # sync 00:07:58.964 17:56:07 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:58.964 17:56:07 -- target/filesystem.sh@27 -- # sync 00:07:58.964 17:56:07 -- target/filesystem.sh@29 -- # i=0 00:07:58.964 17:56:07 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:58.964 17:56:07 -- target/filesystem.sh@37 -- # kill -0 857197 00:07:58.964 17:56:07 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:58.964 17:56:07 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:58.964 17:56:07 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:58.964 17:56:07 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:58.964 00:07:58.964 real 0m0.279s 00:07:58.964 user 0m0.041s 00:07:58.964 sys 0m0.132s 00:07:58.964 17:56:07 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:58.964 17:56:07 -- common/autotest_common.sh@10 -- # set +x 00:07:58.964 ************************************ 00:07:58.964 END TEST filesystem_in_capsule_btrfs 00:07:58.964 ************************************ 00:07:58.964 17:56:08 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:58.964 17:56:08 -- common/autotest_common.sh@1097 -- # '[' 4 -le 1 ']' 00:07:58.964 17:56:08 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:07:58.964 17:56:08 -- common/autotest_common.sh@10 -- # set +x 00:07:59.223 ************************************ 00:07:59.223 START TEST filesystem_in_capsule_xfs 00:07:59.223 ************************************ 00:07:59.223 17:56:08 -- common/autotest_common.sh@1121 -- # nvmf_filesystem_create xfs nvme0n1 00:07:59.223 17:56:08 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:59.223 17:56:08 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:59.223 17:56:08 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:59.223 17:56:08 -- common/autotest_common.sh@922 -- # local fstype=xfs 00:07:59.223 17:56:08 -- common/autotest_common.sh@923 -- # local dev_name=/dev/nvme0n1p1 00:07:59.223 17:56:08 -- common/autotest_common.sh@924 -- # local i=0 00:07:59.223 17:56:08 -- common/autotest_common.sh@925 -- # local force 00:07:59.223 17:56:08 -- common/autotest_common.sh@927 -- # '[' xfs = ext4 ']' 00:07:59.223 17:56:08 -- common/autotest_common.sh@930 -- # force=-f 00:07:59.223 17:56:08 -- common/autotest_common.sh@933 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:59.223 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:59.223 = sectsz=512 attr=2, projid32bit=1 00:07:59.223 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:59.223 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:59.223 data = bsize=4096 blocks=130560, imaxpct=25 00:07:59.223 = sunit=0 swidth=0 blks 00:07:59.223 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:59.223 log =internal log bsize=4096 blocks=16384, version=2 00:07:59.223 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:59.223 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:59.223 Discarding blocks...Done. 00:07:59.223 17:56:08 -- common/autotest_common.sh@941 -- # return 0 00:07:59.223 17:56:08 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:59.223 17:56:08 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:59.223 17:56:08 -- target/filesystem.sh@25 -- # sync 00:07:59.223 17:56:08 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:59.223 17:56:08 -- target/filesystem.sh@27 -- # sync 00:07:59.223 17:56:08 -- target/filesystem.sh@29 -- # i=0 00:07:59.223 17:56:08 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:59.223 17:56:08 -- target/filesystem.sh@37 -- # kill -0 857197 00:07:59.223 17:56:08 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:59.223 17:56:08 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:59.223 17:56:08 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:59.223 17:56:08 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:59.223 00:07:59.223 real 0m0.214s 00:07:59.223 user 0m0.034s 00:07:59.223 sys 0m0.072s 00:07:59.223 17:56:08 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:07:59.223 17:56:08 -- common/autotest_common.sh@10 -- # set +x 00:07:59.223 ************************************ 00:07:59.223 END TEST filesystem_in_capsule_xfs 00:07:59.223 ************************************ 00:07:59.481 17:56:08 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:59.481 17:56:08 -- target/filesystem.sh@93 -- # sync 00:07:59.481 17:56:08 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:00.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:00.418 17:56:09 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:00.418 17:56:09 -- common/autotest_common.sh@1215 -- # local i=0 00:08:00.418 17:56:09 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:08:00.418 17:56:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:00.418 17:56:09 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:08:00.418 17:56:09 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:00.418 17:56:09 -- common/autotest_common.sh@1227 -- # return 0 00:08:00.418 17:56:09 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:00.418 17:56:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:00.418 17:56:09 -- common/autotest_common.sh@10 -- # set +x 00:08:00.418 17:56:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:00.418 17:56:09 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:00.418 17:56:09 -- target/filesystem.sh@101 -- # killprocess 857197 00:08:00.418 17:56:09 -- common/autotest_common.sh@946 -- # '[' -z 857197 ']' 00:08:00.418 17:56:09 -- common/autotest_common.sh@950 -- # kill -0 857197 00:08:00.418 17:56:09 -- common/autotest_common.sh@951 -- # uname 00:08:00.418 17:56:09 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:00.418 17:56:09 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 857197 00:08:00.418 17:56:09 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:00.418 17:56:09 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:00.418 17:56:09 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 857197' 00:08:00.418 killing process with pid 857197 00:08:00.418 17:56:09 -- common/autotest_common.sh@965 -- # kill 857197 00:08:00.418 17:56:09 -- common/autotest_common.sh@970 -- # wait 857197 00:08:00.677 [2024-04-26 17:56:09.655097] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:00.937 17:56:10 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:00.937 00:08:00.937 real 0m8.513s 00:08:00.937 user 0m33.143s 00:08:00.937 sys 0m1.479s 00:08:00.937 17:56:10 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:00.937 17:56:10 -- common/autotest_common.sh@10 -- # set +x 00:08:00.937 ************************************ 00:08:00.937 END TEST nvmf_filesystem_in_capsule 00:08:00.937 ************************************ 00:08:00.937 17:56:10 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:00.937 17:56:10 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:00.937 17:56:10 -- nvmf/common.sh@117 -- # sync 00:08:00.937 17:56:10 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:00.937 17:56:10 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:00.937 17:56:10 -- nvmf/common.sh@120 -- # set +e 00:08:00.937 17:56:10 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:00.937 17:56:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:01.196 rmmod nvme_rdma 00:08:01.196 rmmod nvme_fabrics 00:08:01.196 17:56:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:01.196 17:56:10 -- nvmf/common.sh@124 -- # set -e 00:08:01.196 17:56:10 -- nvmf/common.sh@125 -- # return 0 00:08:01.196 17:56:10 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:08:01.196 17:56:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:01.196 17:56:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:01.196 00:08:01.196 real 0m23.856s 00:08:01.196 user 1m8.225s 00:08:01.196 sys 0m7.938s 00:08:01.196 17:56:10 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:01.196 17:56:10 -- common/autotest_common.sh@10 -- # set +x 00:08:01.196 ************************************ 00:08:01.196 END TEST nvmf_filesystem 00:08:01.196 ************************************ 00:08:01.196 17:56:10 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:01.196 17:56:10 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:01.196 17:56:10 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:01.196 17:56:10 -- common/autotest_common.sh@10 -- # set +x 00:08:01.196 ************************************ 00:08:01.196 START TEST nvmf_discovery 00:08:01.196 ************************************ 00:08:01.196 17:56:10 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=rdma 00:08:01.456 * Looking for test storage... 00:08:01.456 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:01.456 17:56:10 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:01.456 17:56:10 -- nvmf/common.sh@7 -- # uname -s 00:08:01.456 17:56:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:01.456 17:56:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:01.456 17:56:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:01.456 17:56:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:01.456 17:56:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:01.456 17:56:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:01.456 17:56:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:01.456 17:56:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:01.456 17:56:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:01.456 17:56:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:01.456 17:56:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:01.456 17:56:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:01.456 17:56:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:01.456 17:56:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:01.456 17:56:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:01.456 17:56:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:01.456 17:56:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:01.456 17:56:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:01.456 17:56:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:01.456 17:56:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:01.456 17:56:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.456 17:56:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.456 17:56:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.456 17:56:10 -- paths/export.sh@5 -- # export PATH 00:08:01.456 17:56:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:01.456 17:56:10 -- nvmf/common.sh@47 -- # : 0 00:08:01.456 17:56:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:01.456 17:56:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:01.456 17:56:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:01.456 17:56:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:01.456 17:56:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:01.456 17:56:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:01.456 17:56:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:01.456 17:56:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:01.456 17:56:10 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:01.456 17:56:10 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:01.456 17:56:10 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:01.456 17:56:10 -- target/discovery.sh@15 -- # hash nvme 00:08:01.456 17:56:10 -- target/discovery.sh@20 -- # nvmftestinit 00:08:01.456 17:56:10 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:01.456 17:56:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:01.456 17:56:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:01.456 17:56:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:01.456 17:56:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:01.456 17:56:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:01.456 17:56:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:01.456 17:56:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:01.456 17:56:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:01.456 17:56:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:01.456 17:56:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:01.456 17:56:10 -- common/autotest_common.sh@10 -- # set +x 00:08:08.029 17:56:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:08.029 17:56:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:08.029 17:56:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:08.029 17:56:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:08.029 17:56:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:08.029 17:56:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:08.029 17:56:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:08.029 17:56:16 -- nvmf/common.sh@295 -- # net_devs=() 00:08:08.029 17:56:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:08.029 17:56:16 -- nvmf/common.sh@296 -- # e810=() 00:08:08.029 17:56:16 -- nvmf/common.sh@296 -- # local -ga e810 00:08:08.029 17:56:16 -- nvmf/common.sh@297 -- # x722=() 00:08:08.029 17:56:16 -- nvmf/common.sh@297 -- # local -ga x722 00:08:08.029 17:56:16 -- nvmf/common.sh@298 -- # mlx=() 00:08:08.029 17:56:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:08.029 17:56:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:08.029 17:56:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:08.029 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:08.029 17:56:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:08.029 17:56:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:08.029 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:08.029 17:56:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:08.029 17:56:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:08.029 17:56:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:08.029 17:56:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:08.029 Found net devices under 0000:18:00.0: mlx_0_0 00:08:08.029 17:56:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:08.029 17:56:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:08.029 17:56:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:08.029 Found net devices under 0000:18:00.1: mlx_0_1 00:08:08.029 17:56:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:08.029 17:56:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:08.029 17:56:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:08.029 17:56:16 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:08.029 17:56:16 -- nvmf/common.sh@58 -- # uname 00:08:08.029 17:56:16 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:08.029 17:56:16 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:08.029 17:56:16 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:08.029 17:56:16 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:08.029 17:56:16 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:08.029 17:56:16 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:08.029 17:56:16 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:08.029 17:56:16 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:08.029 17:56:16 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:08.029 17:56:16 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:08.029 17:56:16 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:08.029 17:56:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:08.029 17:56:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:08.029 17:56:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:08.029 17:56:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:08.029 17:56:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:08.029 17:56:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:08.029 17:56:16 -- nvmf/common.sh@105 -- # continue 2 00:08:08.029 17:56:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.029 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:08.029 17:56:16 -- nvmf/common.sh@105 -- # continue 2 00:08:08.029 17:56:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:08.029 17:56:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:08.029 17:56:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:08.029 17:56:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:08.029 17:56:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.029 17:56:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.029 17:56:16 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:08.029 17:56:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:08.029 17:56:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:08.030 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:08.030 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:08:08.030 altname enp24s0f0np0 00:08:08.030 altname ens785f0np0 00:08:08.030 inet 192.168.100.8/24 scope global mlx_0_0 00:08:08.030 valid_lft forever preferred_lft forever 00:08:08.030 17:56:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:08.030 17:56:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.030 17:56:16 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:08.030 17:56:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:08.030 17:56:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:08.030 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:08.030 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:08:08.030 altname enp24s0f1np1 00:08:08.030 altname ens785f1np1 00:08:08.030 inet 192.168.100.9/24 scope global mlx_0_1 00:08:08.030 valid_lft forever preferred_lft forever 00:08:08.030 17:56:16 -- nvmf/common.sh@411 -- # return 0 00:08:08.030 17:56:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:08.030 17:56:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:08.030 17:56:16 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:08.030 17:56:16 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:08.030 17:56:16 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:08.030 17:56:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:08.030 17:56:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:08.030 17:56:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:08.030 17:56:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:08.030 17:56:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:08.030 17:56:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.030 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.030 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:08.030 17:56:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:08.030 17:56:16 -- nvmf/common.sh@105 -- # continue 2 00:08:08.030 17:56:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:08.030 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.030 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:08.030 17:56:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:08.030 17:56:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:08.030 17:56:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@105 -- # continue 2 00:08:08.030 17:56:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:08.030 17:56:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:08.030 17:56:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.030 17:56:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:08.030 17:56:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:08.030 17:56:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:08.030 17:56:16 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:08.030 192.168.100.9' 00:08:08.030 17:56:16 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:08.030 192.168.100.9' 00:08:08.030 17:56:16 -- nvmf/common.sh@446 -- # head -n 1 00:08:08.030 17:56:16 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:08.030 17:56:16 -- nvmf/common.sh@447 -- # tail -n +2 00:08:08.030 17:56:16 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:08.030 192.168.100.9' 00:08:08.030 17:56:16 -- nvmf/common.sh@447 -- # head -n 1 00:08:08.030 17:56:16 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:08.030 17:56:16 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:08.030 17:56:16 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:08.030 17:56:16 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:08.030 17:56:16 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:08.030 17:56:16 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:08.030 17:56:16 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:08.030 17:56:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:08.030 17:56:16 -- common/autotest_common.sh@720 -- # xtrace_disable 00:08:08.030 17:56:16 -- common/autotest_common.sh@10 -- # set +x 00:08:08.030 17:56:16 -- nvmf/common.sh@470 -- # nvmfpid=861412 00:08:08.030 17:56:16 -- nvmf/common.sh@471 -- # waitforlisten 861412 00:08:08.030 17:56:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:08.030 17:56:16 -- common/autotest_common.sh@827 -- # '[' -z 861412 ']' 00:08:08.030 17:56:16 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:08.030 17:56:16 -- common/autotest_common.sh@832 -- # local max_retries=100 00:08:08.030 17:56:16 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:08.030 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:08.030 17:56:16 -- common/autotest_common.sh@836 -- # xtrace_disable 00:08:08.030 17:56:16 -- common/autotest_common.sh@10 -- # set +x 00:08:08.030 [2024-04-26 17:56:16.541639] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:08:08.030 [2024-04-26 17:56:16.541696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:08.030 EAL: No free 2048 kB hugepages reported on node 1 00:08:08.030 [2024-04-26 17:56:16.613233] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:08.030 [2024-04-26 17:56:16.701937] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:08.030 [2024-04-26 17:56:16.701977] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:08.030 [2024-04-26 17:56:16.701987] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:08.030 [2024-04-26 17:56:16.701997] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:08.030 [2024-04-26 17:56:16.702005] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:08.030 [2024-04-26 17:56:16.702064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:08.030 [2024-04-26 17:56:16.702154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:08.030 [2024-04-26 17:56:16.702231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:08.030 [2024-04-26 17:56:16.702232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.289 17:56:17 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:08:08.289 17:56:17 -- common/autotest_common.sh@860 -- # return 0 00:08:08.289 17:56:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:08.289 17:56:17 -- common/autotest_common.sh@726 -- # xtrace_disable 00:08:08.289 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.289 17:56:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:08.289 17:56:17 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:08.289 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.289 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.289 [2024-04-26 17:56:17.435956] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb174d0/0xb1b9c0) succeed. 00:08:08.289 [2024-04-26 17:56:17.446507] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb18b10/0xb5d050) succeed. 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@26 -- # seq 1 4 00:08:08.548 17:56:17 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:08.548 17:56:17 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 Null1 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 [2024-04-26 17:56:17.610347] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:08.548 17:56:17 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 Null2 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:08.548 17:56:17 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 Null3 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:08.548 17:56:17 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 Null4 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 192.168.100.8 -s 4430 00:08:08.548 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.548 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.548 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.548 17:56:17 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:08:08.808 00:08:08.808 Discovery Log Number of Records 6, Generation counter 6 00:08:08.808 =====Discovery Log Entry 0====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: current discovery subsystem 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4420 00:08:08.808 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: explicit discovery connections, duplicate discovery information 00:08:08.808 rdma_prtype: not specified 00:08:08.808 rdma_qptype: connected 00:08:08.808 rdma_cms: rdma-cm 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 =====Discovery Log Entry 1====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: nvme subsystem 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4420 00:08:08.808 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: none 00:08:08.808 rdma_prtype: not specified 00:08:08.808 rdma_qptype: connected 00:08:08.808 rdma_cms: rdma-cm 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 =====Discovery Log Entry 2====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: nvme subsystem 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4420 00:08:08.808 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: none 00:08:08.808 rdma_prtype: not specified 00:08:08.808 rdma_qptype: connected 00:08:08.808 rdma_cms: rdma-cm 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 =====Discovery Log Entry 3====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: nvme subsystem 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4420 00:08:08.808 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: none 00:08:08.808 rdma_prtype: not specified 00:08:08.808 rdma_qptype: connected 00:08:08.808 rdma_cms: rdma-cm 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 =====Discovery Log Entry 4====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: nvme subsystem 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4420 00:08:08.808 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: none 00:08:08.808 rdma_prtype: not specified 00:08:08.808 rdma_qptype: connected 00:08:08.808 rdma_cms: rdma-cm 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 =====Discovery Log Entry 5====== 00:08:08.808 trtype: rdma 00:08:08.808 adrfam: ipv4 00:08:08.808 subtype: discovery subsystem referral 00:08:08.808 treq: not required 00:08:08.808 portid: 0 00:08:08.808 trsvcid: 4430 00:08:08.808 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:08.808 traddr: 192.168.100.8 00:08:08.808 eflags: none 00:08:08.808 rdma_prtype: unrecognized 00:08:08.808 rdma_qptype: unrecognized 00:08:08.808 rdma_cms: unrecognized 00:08:08.808 rdma_pkey: 0x0000 00:08:08.808 17:56:17 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:08.808 Perform nvmf subsystem discovery via RPC 00:08:08.808 17:56:17 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:08.808 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.808 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.808 [2024-04-26 17:56:17.830788] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:08.808 [ 00:08:08.808 { 00:08:08.808 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:08.808 "subtype": "Discovery", 00:08:08.808 "listen_addresses": [ 00:08:08.808 { 00:08:08.808 "transport": "RDMA", 00:08:08.808 "trtype": "RDMA", 00:08:08.808 "adrfam": "IPv4", 00:08:08.808 "traddr": "192.168.100.8", 00:08:08.808 "trsvcid": "4420" 00:08:08.808 } 00:08:08.808 ], 00:08:08.808 "allow_any_host": true, 00:08:08.808 "hosts": [] 00:08:08.808 }, 00:08:08.808 { 00:08:08.808 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:08.808 "subtype": "NVMe", 00:08:08.808 "listen_addresses": [ 00:08:08.808 { 00:08:08.808 "transport": "RDMA", 00:08:08.808 "trtype": "RDMA", 00:08:08.808 "adrfam": "IPv4", 00:08:08.808 "traddr": "192.168.100.8", 00:08:08.808 "trsvcid": "4420" 00:08:08.808 } 00:08:08.808 ], 00:08:08.808 "allow_any_host": true, 00:08:08.808 "hosts": [], 00:08:08.808 "serial_number": "SPDK00000000000001", 00:08:08.808 "model_number": "SPDK bdev Controller", 00:08:08.808 "max_namespaces": 32, 00:08:08.808 "min_cntlid": 1, 00:08:08.808 "max_cntlid": 65519, 00:08:08.808 "namespaces": [ 00:08:08.808 { 00:08:08.808 "nsid": 1, 00:08:08.808 "bdev_name": "Null1", 00:08:08.808 "name": "Null1", 00:08:08.808 "nguid": "DC26A135A58A4479A1E8A8D676D835C7", 00:08:08.808 "uuid": "dc26a135-a58a-4479-a1e8-a8d676d835c7" 00:08:08.808 } 00:08:08.808 ] 00:08:08.808 }, 00:08:08.808 { 00:08:08.808 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:08.808 "subtype": "NVMe", 00:08:08.808 "listen_addresses": [ 00:08:08.808 { 00:08:08.808 "transport": "RDMA", 00:08:08.808 "trtype": "RDMA", 00:08:08.808 "adrfam": "IPv4", 00:08:08.808 "traddr": "192.168.100.8", 00:08:08.808 "trsvcid": "4420" 00:08:08.808 } 00:08:08.808 ], 00:08:08.808 "allow_any_host": true, 00:08:08.808 "hosts": [], 00:08:08.808 "serial_number": "SPDK00000000000002", 00:08:08.808 "model_number": "SPDK bdev Controller", 00:08:08.808 "max_namespaces": 32, 00:08:08.808 "min_cntlid": 1, 00:08:08.808 "max_cntlid": 65519, 00:08:08.808 "namespaces": [ 00:08:08.808 { 00:08:08.808 "nsid": 1, 00:08:08.808 "bdev_name": "Null2", 00:08:08.808 "name": "Null2", 00:08:08.808 "nguid": "FE1084F55C6F441094E4B739DE247D7E", 00:08:08.808 "uuid": "fe1084f5-5c6f-4410-94e4-b739de247d7e" 00:08:08.808 } 00:08:08.808 ] 00:08:08.808 }, 00:08:08.808 { 00:08:08.808 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:08.808 "subtype": "NVMe", 00:08:08.808 "listen_addresses": [ 00:08:08.808 { 00:08:08.808 "transport": "RDMA", 00:08:08.808 "trtype": "RDMA", 00:08:08.808 "adrfam": "IPv4", 00:08:08.808 "traddr": "192.168.100.8", 00:08:08.808 "trsvcid": "4420" 00:08:08.808 } 00:08:08.808 ], 00:08:08.808 "allow_any_host": true, 00:08:08.808 "hosts": [], 00:08:08.808 "serial_number": "SPDK00000000000003", 00:08:08.809 "model_number": "SPDK bdev Controller", 00:08:08.809 "max_namespaces": 32, 00:08:08.809 "min_cntlid": 1, 00:08:08.809 "max_cntlid": 65519, 00:08:08.809 "namespaces": [ 00:08:08.809 { 00:08:08.809 "nsid": 1, 00:08:08.809 "bdev_name": "Null3", 00:08:08.809 "name": "Null3", 00:08:08.809 "nguid": "0EBBC5E7BCA04367B6F42C0DF6E17B8E", 00:08:08.809 "uuid": "0ebbc5e7-bca0-4367-b6f4-2c0df6e17b8e" 00:08:08.809 } 00:08:08.809 ] 00:08:08.809 }, 00:08:08.809 { 00:08:08.809 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:08.809 "subtype": "NVMe", 00:08:08.809 "listen_addresses": [ 00:08:08.809 { 00:08:08.809 "transport": "RDMA", 00:08:08.809 "trtype": "RDMA", 00:08:08.809 "adrfam": "IPv4", 00:08:08.809 "traddr": "192.168.100.8", 00:08:08.809 "trsvcid": "4420" 00:08:08.809 } 00:08:08.809 ], 00:08:08.809 "allow_any_host": true, 00:08:08.809 "hosts": [], 00:08:08.809 "serial_number": "SPDK00000000000004", 00:08:08.809 "model_number": "SPDK bdev Controller", 00:08:08.809 "max_namespaces": 32, 00:08:08.809 "min_cntlid": 1, 00:08:08.809 "max_cntlid": 65519, 00:08:08.809 "namespaces": [ 00:08:08.809 { 00:08:08.809 "nsid": 1, 00:08:08.809 "bdev_name": "Null4", 00:08:08.809 "name": "Null4", 00:08:08.809 "nguid": "0F8BAE4FE04148D7A6B7437554FF6265", 00:08:08.809 "uuid": "0f8bae4f-e041-48d7-a6b7-437554ff6265" 00:08:08.809 } 00:08:08.809 ] 00:08:08.809 } 00:08:08.809 ] 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@42 -- # seq 1 4 00:08:08.809 17:56:17 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:08.809 17:56:17 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:08.809 17:56:17 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:08.809 17:56:17 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:08.809 17:56:17 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 192.168.100.8 -s 4430 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:08.809 17:56:17 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:08.809 17:56:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:08.809 17:56:17 -- common/autotest_common.sh@10 -- # set +x 00:08:08.809 17:56:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:08.809 17:56:17 -- target/discovery.sh@49 -- # check_bdevs= 00:08:08.809 17:56:17 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:08.809 17:56:17 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:08.809 17:56:17 -- target/discovery.sh@57 -- # nvmftestfini 00:08:08.809 17:56:17 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:08.809 17:56:17 -- nvmf/common.sh@117 -- # sync 00:08:08.809 17:56:17 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:08.809 17:56:17 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:08.809 17:56:17 -- nvmf/common.sh@120 -- # set +e 00:08:08.809 17:56:17 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:08.809 17:56:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:08.809 rmmod nvme_rdma 00:08:09.068 rmmod nvme_fabrics 00:08:09.068 17:56:18 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:09.068 17:56:18 -- nvmf/common.sh@124 -- # set -e 00:08:09.068 17:56:18 -- nvmf/common.sh@125 -- # return 0 00:08:09.068 17:56:18 -- nvmf/common.sh@478 -- # '[' -n 861412 ']' 00:08:09.068 17:56:18 -- nvmf/common.sh@479 -- # killprocess 861412 00:08:09.068 17:56:18 -- common/autotest_common.sh@946 -- # '[' -z 861412 ']' 00:08:09.068 17:56:18 -- common/autotest_common.sh@950 -- # kill -0 861412 00:08:09.068 17:56:18 -- common/autotest_common.sh@951 -- # uname 00:08:09.068 17:56:18 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:09.068 17:56:18 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 861412 00:08:09.068 17:56:18 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:09.068 17:56:18 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:09.068 17:56:18 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 861412' 00:08:09.068 killing process with pid 861412 00:08:09.068 17:56:18 -- common/autotest_common.sh@965 -- # kill 861412 00:08:09.068 [2024-04-26 17:56:18.086183] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:09.068 17:56:18 -- common/autotest_common.sh@970 -- # wait 861412 00:08:09.068 [2024-04-26 17:56:18.173021] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:09.328 17:56:18 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:09.328 17:56:18 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:09.328 00:08:09.328 real 0m7.996s 00:08:09.328 user 0m8.306s 00:08:09.328 sys 0m5.082s 00:08:09.328 17:56:18 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:09.328 17:56:18 -- common/autotest_common.sh@10 -- # set +x 00:08:09.328 ************************************ 00:08:09.328 END TEST nvmf_discovery 00:08:09.328 ************************************ 00:08:09.328 17:56:18 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:09.328 17:56:18 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:09.328 17:56:18 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:09.328 17:56:18 -- common/autotest_common.sh@10 -- # set +x 00:08:09.587 ************************************ 00:08:09.587 START TEST nvmf_referrals 00:08:09.587 ************************************ 00:08:09.587 17:56:18 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=rdma 00:08:09.587 * Looking for test storage... 00:08:09.587 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:09.587 17:56:18 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:09.587 17:56:18 -- nvmf/common.sh@7 -- # uname -s 00:08:09.587 17:56:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:09.587 17:56:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:09.587 17:56:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:09.587 17:56:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:09.587 17:56:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:09.587 17:56:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:09.587 17:56:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:09.587 17:56:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:09.587 17:56:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:09.587 17:56:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:09.587 17:56:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:09.587 17:56:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:09.587 17:56:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:09.587 17:56:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:09.587 17:56:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:09.587 17:56:18 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:09.587 17:56:18 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:09.587 17:56:18 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:09.587 17:56:18 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:09.588 17:56:18 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:09.588 17:56:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.588 17:56:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.588 17:56:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.588 17:56:18 -- paths/export.sh@5 -- # export PATH 00:08:09.588 17:56:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:09.588 17:56:18 -- nvmf/common.sh@47 -- # : 0 00:08:09.588 17:56:18 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:09.588 17:56:18 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:09.588 17:56:18 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:09.588 17:56:18 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:09.588 17:56:18 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:09.588 17:56:18 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:09.588 17:56:18 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:09.588 17:56:18 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:09.588 17:56:18 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:09.588 17:56:18 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:09.588 17:56:18 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:09.588 17:56:18 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:09.588 17:56:18 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:09.588 17:56:18 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:09.588 17:56:18 -- target/referrals.sh@37 -- # nvmftestinit 00:08:09.588 17:56:18 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:09.588 17:56:18 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:09.588 17:56:18 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:09.588 17:56:18 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:09.588 17:56:18 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:09.588 17:56:18 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:09.588 17:56:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:09.588 17:56:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:09.588 17:56:18 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:09.588 17:56:18 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:09.588 17:56:18 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:09.588 17:56:18 -- common/autotest_common.sh@10 -- # set +x 00:08:16.161 17:56:24 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:16.161 17:56:24 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:16.161 17:56:24 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:16.161 17:56:24 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:16.161 17:56:24 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:16.161 17:56:24 -- nvmf/common.sh@295 -- # net_devs=() 00:08:16.161 17:56:24 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@296 -- # e810=() 00:08:16.161 17:56:24 -- nvmf/common.sh@296 -- # local -ga e810 00:08:16.161 17:56:24 -- nvmf/common.sh@297 -- # x722=() 00:08:16.161 17:56:24 -- nvmf/common.sh@297 -- # local -ga x722 00:08:16.161 17:56:24 -- nvmf/common.sh@298 -- # mlx=() 00:08:16.161 17:56:24 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:16.161 17:56:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:16.161 17:56:24 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:16.161 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:16.161 17:56:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:16.161 17:56:24 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:16.161 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:16.161 17:56:24 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:16.161 17:56:24 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.161 17:56:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.161 17:56:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:16.161 Found net devices under 0000:18:00.0: mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:16.161 17:56:24 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:16.161 17:56:24 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:16.161 Found net devices under 0000:18:00.1: mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:16.161 17:56:24 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:16.161 17:56:24 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:16.161 17:56:24 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:16.161 17:56:24 -- nvmf/common.sh@58 -- # uname 00:08:16.161 17:56:24 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:16.161 17:56:24 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:16.161 17:56:24 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:16.161 17:56:24 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:16.161 17:56:24 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:16.161 17:56:24 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:16.161 17:56:24 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:16.161 17:56:24 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:16.161 17:56:24 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:16.161 17:56:24 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:16.161 17:56:24 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:16.161 17:56:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:16.161 17:56:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:16.161 17:56:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@105 -- # continue 2 00:08:16.161 17:56:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@105 -- # continue 2 00:08:16.161 17:56:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:16.161 17:56:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.161 17:56:24 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:16.161 17:56:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:16.161 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:16.161 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:08:16.161 altname enp24s0f0np0 00:08:16.161 altname ens785f0np0 00:08:16.161 inet 192.168.100.8/24 scope global mlx_0_0 00:08:16.161 valid_lft forever preferred_lft forever 00:08:16.161 17:56:24 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:16.161 17:56:24 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.161 17:56:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.161 17:56:24 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:16.161 17:56:24 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:16.161 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:16.161 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:08:16.161 altname enp24s0f1np1 00:08:16.161 altname ens785f1np1 00:08:16.161 inet 192.168.100.9/24 scope global mlx_0_1 00:08:16.161 valid_lft forever preferred_lft forever 00:08:16.161 17:56:24 -- nvmf/common.sh@411 -- # return 0 00:08:16.161 17:56:24 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:16.161 17:56:24 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:16.161 17:56:24 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:16.161 17:56:24 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:16.161 17:56:24 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:16.161 17:56:24 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:16.161 17:56:24 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:16.161 17:56:24 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:16.161 17:56:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:16.161 17:56:24 -- nvmf/common.sh@105 -- # continue 2 00:08:16.161 17:56:24 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:16.161 17:56:24 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:16.161 17:56:24 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:16.161 17:56:24 -- nvmf/common.sh@105 -- # continue 2 00:08:16.161 17:56:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:16.162 17:56:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:16.162 17:56:24 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.162 17:56:24 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:16.162 17:56:24 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:16.162 17:56:24 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:16.162 17:56:24 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:16.162 17:56:24 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:16.162 192.168.100.9' 00:08:16.162 17:56:24 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:16.162 192.168.100.9' 00:08:16.162 17:56:24 -- nvmf/common.sh@446 -- # head -n 1 00:08:16.162 17:56:24 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:16.162 17:56:24 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:16.162 192.168.100.9' 00:08:16.162 17:56:24 -- nvmf/common.sh@447 -- # tail -n +2 00:08:16.162 17:56:24 -- nvmf/common.sh@447 -- # head -n 1 00:08:16.162 17:56:24 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:16.162 17:56:24 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:16.162 17:56:24 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:16.162 17:56:24 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:16.162 17:56:24 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:16.162 17:56:24 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:16.162 17:56:24 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:16.162 17:56:24 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:16.162 17:56:24 -- common/autotest_common.sh@720 -- # xtrace_disable 00:08:16.162 17:56:24 -- common/autotest_common.sh@10 -- # set +x 00:08:16.162 17:56:24 -- nvmf/common.sh@470 -- # nvmfpid=864534 00:08:16.162 17:56:24 -- nvmf/common.sh@471 -- # waitforlisten 864534 00:08:16.162 17:56:24 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:16.162 17:56:24 -- common/autotest_common.sh@827 -- # '[' -z 864534 ']' 00:08:16.162 17:56:24 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:16.162 17:56:24 -- common/autotest_common.sh@832 -- # local max_retries=100 00:08:16.162 17:56:24 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:16.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:16.162 17:56:24 -- common/autotest_common.sh@836 -- # xtrace_disable 00:08:16.162 17:56:24 -- common/autotest_common.sh@10 -- # set +x 00:08:16.162 [2024-04-26 17:56:24.677316] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:08:16.162 [2024-04-26 17:56:24.677380] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:16.162 EAL: No free 2048 kB hugepages reported on node 1 00:08:16.162 [2024-04-26 17:56:24.749800] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:16.162 [2024-04-26 17:56:24.835145] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:16.162 [2024-04-26 17:56:24.835190] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:16.162 [2024-04-26 17:56:24.835199] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:16.162 [2024-04-26 17:56:24.835207] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:16.162 [2024-04-26 17:56:24.835214] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:16.162 [2024-04-26 17:56:24.835307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:16.162 [2024-04-26 17:56:24.835622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:16.162 [2024-04-26 17:56:24.835646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:16.162 [2024-04-26 17:56:24.835648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.477 17:56:25 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:08:16.478 17:56:25 -- common/autotest_common.sh@860 -- # return 0 00:08:16.478 17:56:25 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:16.478 17:56:25 -- common/autotest_common.sh@726 -- # xtrace_disable 00:08:16.478 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.478 17:56:25 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:16.478 17:56:25 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:08:16.478 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.478 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.478 [2024-04-26 17:56:25.558914] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a284d0/0x1a2c9c0) succeed. 00:08:16.478 [2024-04-26 17:56:25.569377] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a29b10/0x1a6e050) succeed. 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t rdma -a 192.168.100.8 -s 8009 discovery 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 [2024-04-26 17:56:25.698441] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 8009 *** 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.3 -s 4430 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.4 -s 4430 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:16.748 17:56:25 -- target/referrals.sh@48 -- # jq length 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:16.748 17:56:25 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:16.748 17:56:25 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:16.748 17:56:25 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- target/referrals.sh@21 -- # sort 00:08:16.748 17:56:25 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:16.748 17:56:25 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:16.748 17:56:25 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:16.748 17:56:25 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:16.748 17:56:25 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:16.748 17:56:25 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:16.748 17:56:25 -- target/referrals.sh@26 -- # sort 00:08:16.748 17:56:25 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:16.748 17:56:25 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:16.748 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:16.748 17:56:25 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.3 -s 4430 00:08:16.748 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:16.748 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:25 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.4 -s 4430 00:08:17.008 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.008 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:25 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:17.008 17:56:25 -- target/referrals.sh@56 -- # jq length 00:08:17.008 17:56:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.008 17:56:25 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:25 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:17.008 17:56:25 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:17.008 17:56:25 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:17.008 17:56:25 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:17.008 17:56:25 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.008 17:56:25 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:17.008 17:56:25 -- target/referrals.sh@26 -- # sort 00:08:17.008 17:56:26 -- target/referrals.sh@26 -- # echo 00:08:17.008 17:56:26 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:17.008 17:56:26 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n discovery 00:08:17.008 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.008 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:26 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:17.008 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.008 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:26 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:17.008 17:56:26 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:17.008 17:56:26 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:17.008 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.008 17:56:26 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:17.008 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.008 17:56:26 -- target/referrals.sh@21 -- # sort 00:08:17.008 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.008 17:56:26 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:17.008 17:56:26 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:17.008 17:56:26 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:17.008 17:56:26 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:17.008 17:56:26 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:17.008 17:56:26 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.008 17:56:26 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:17.008 17:56:26 -- target/referrals.sh@26 -- # sort 00:08:17.267 17:56:26 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:17.267 17:56:26 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:17.268 17:56:26 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:17.268 17:56:26 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:17.268 17:56:26 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:17.268 17:56:26 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.268 17:56:26 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:17.268 17:56:26 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:17.268 17:56:26 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:17.268 17:56:26 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:17.268 17:56:26 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.268 17:56:26 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:17.268 17:56:26 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:17.268 17:56:26 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:17.268 17:56:26 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:17.268 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.268 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.527 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.527 17:56:26 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:17.527 17:56:26 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:17.527 17:56:26 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:17.527 17:56:26 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:17.527 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.527 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.527 17:56:26 -- target/referrals.sh@21 -- # sort 00:08:17.527 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.527 17:56:26 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:17.527 17:56:26 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:17.527 17:56:26 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:17.527 17:56:26 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:17.527 17:56:26 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:17.527 17:56:26 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:17.527 17:56:26 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.527 17:56:26 -- target/referrals.sh@26 -- # sort 00:08:17.527 17:56:26 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:17.527 17:56:26 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:17.527 17:56:26 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:17.527 17:56:26 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:17.527 17:56:26 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:17.527 17:56:26 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.527 17:56:26 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:17.527 17:56:26 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:17.527 17:56:26 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:17.527 17:56:26 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:17.527 17:56:26 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:17.527 17:56:26 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.527 17:56:26 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:17.786 17:56:26 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:17.786 17:56:26 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t rdma -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:17.786 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.786 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.786 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.786 17:56:26 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:17.786 17:56:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:17.786 17:56:26 -- common/autotest_common.sh@10 -- # set +x 00:08:17.786 17:56:26 -- target/referrals.sh@82 -- # jq length 00:08:17.786 17:56:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:17.786 17:56:26 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:17.786 17:56:26 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:17.786 17:56:26 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:17.786 17:56:26 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:17.786 17:56:26 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 8009 -o json 00:08:17.786 17:56:26 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:17.786 17:56:26 -- target/referrals.sh@26 -- # sort 00:08:17.786 17:56:26 -- target/referrals.sh@26 -- # echo 00:08:17.786 17:56:26 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:17.786 17:56:26 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:17.786 17:56:26 -- target/referrals.sh@86 -- # nvmftestfini 00:08:17.786 17:56:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:17.786 17:56:26 -- nvmf/common.sh@117 -- # sync 00:08:17.786 17:56:26 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:17.786 17:56:26 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:17.786 17:56:26 -- nvmf/common.sh@120 -- # set +e 00:08:17.786 17:56:26 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:17.786 17:56:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:17.786 rmmod nvme_rdma 00:08:18.045 rmmod nvme_fabrics 00:08:18.045 17:56:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:18.045 17:56:27 -- nvmf/common.sh@124 -- # set -e 00:08:18.045 17:56:27 -- nvmf/common.sh@125 -- # return 0 00:08:18.045 17:56:27 -- nvmf/common.sh@478 -- # '[' -n 864534 ']' 00:08:18.045 17:56:27 -- nvmf/common.sh@479 -- # killprocess 864534 00:08:18.045 17:56:27 -- common/autotest_common.sh@946 -- # '[' -z 864534 ']' 00:08:18.045 17:56:27 -- common/autotest_common.sh@950 -- # kill -0 864534 00:08:18.045 17:56:27 -- common/autotest_common.sh@951 -- # uname 00:08:18.045 17:56:27 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:18.045 17:56:27 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 864534 00:08:18.045 17:56:27 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:18.045 17:56:27 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:18.045 17:56:27 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 864534' 00:08:18.045 killing process with pid 864534 00:08:18.045 17:56:27 -- common/autotest_common.sh@965 -- # kill 864534 00:08:18.045 17:56:27 -- common/autotest_common.sh@970 -- # wait 864534 00:08:18.045 [2024-04-26 17:56:27.155026] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:18.305 17:56:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:18.305 17:56:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:18.305 00:08:18.305 real 0m8.784s 00:08:18.305 user 0m12.486s 00:08:18.305 sys 0m5.214s 00:08:18.305 17:56:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:18.305 17:56:27 -- common/autotest_common.sh@10 -- # set +x 00:08:18.305 ************************************ 00:08:18.305 END TEST nvmf_referrals 00:08:18.305 ************************************ 00:08:18.305 17:56:27 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:18.305 17:56:27 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:18.305 17:56:27 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:18.305 17:56:27 -- common/autotest_common.sh@10 -- # set +x 00:08:18.564 ************************************ 00:08:18.564 START TEST nvmf_connect_disconnect 00:08:18.564 ************************************ 00:08:18.564 17:56:27 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=rdma 00:08:18.564 * Looking for test storage... 00:08:18.564 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:18.564 17:56:27 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:18.564 17:56:27 -- nvmf/common.sh@7 -- # uname -s 00:08:18.564 17:56:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:18.564 17:56:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:18.564 17:56:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:18.564 17:56:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:18.564 17:56:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:18.564 17:56:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:18.564 17:56:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:18.564 17:56:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:18.564 17:56:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:18.564 17:56:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:18.564 17:56:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:18.564 17:56:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:18.564 17:56:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:18.564 17:56:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:18.564 17:56:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:18.564 17:56:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:18.564 17:56:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:18.564 17:56:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:18.564 17:56:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:18.564 17:56:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:18.564 17:56:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:18.564 17:56:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:18.564 17:56:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:18.564 17:56:27 -- paths/export.sh@5 -- # export PATH 00:08:18.564 17:56:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:18.564 17:56:27 -- nvmf/common.sh@47 -- # : 0 00:08:18.564 17:56:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:18.564 17:56:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:18.564 17:56:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:18.564 17:56:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:18.564 17:56:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:18.564 17:56:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:18.564 17:56:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:18.564 17:56:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:18.564 17:56:27 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:18.564 17:56:27 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:18.564 17:56:27 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:18.564 17:56:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:18.564 17:56:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:18.564 17:56:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:18.564 17:56:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:18.564 17:56:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:18.564 17:56:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:18.564 17:56:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:18.564 17:56:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:18.564 17:56:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:18.564 17:56:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:18.564 17:56:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:18.564 17:56:27 -- common/autotest_common.sh@10 -- # set +x 00:08:25.132 17:56:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:25.132 17:56:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:25.132 17:56:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:25.132 17:56:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:25.132 17:56:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:25.132 17:56:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:25.132 17:56:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:25.132 17:56:33 -- nvmf/common.sh@295 -- # net_devs=() 00:08:25.132 17:56:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:25.132 17:56:33 -- nvmf/common.sh@296 -- # e810=() 00:08:25.132 17:56:33 -- nvmf/common.sh@296 -- # local -ga e810 00:08:25.132 17:56:33 -- nvmf/common.sh@297 -- # x722=() 00:08:25.132 17:56:33 -- nvmf/common.sh@297 -- # local -ga x722 00:08:25.132 17:56:33 -- nvmf/common.sh@298 -- # mlx=() 00:08:25.132 17:56:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:25.133 17:56:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:25.133 17:56:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:25.133 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:25.133 17:56:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:25.133 17:56:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:25.133 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:25.133 17:56:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:25.133 17:56:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:25.133 17:56:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:25.133 17:56:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:25.133 Found net devices under 0000:18:00.0: mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:25.133 17:56:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:25.133 17:56:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:25.133 Found net devices under 0000:18:00.1: mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:25.133 17:56:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:25.133 17:56:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:25.133 17:56:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:25.133 17:56:33 -- nvmf/common.sh@58 -- # uname 00:08:25.133 17:56:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:25.133 17:56:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:25.133 17:56:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:25.133 17:56:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:25.133 17:56:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:25.133 17:56:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:25.133 17:56:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:25.133 17:56:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:25.133 17:56:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:25.133 17:56:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:25.133 17:56:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:25.133 17:56:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:25.133 17:56:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:25.133 17:56:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:25.133 17:56:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:25.133 17:56:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@105 -- # continue 2 00:08:25.133 17:56:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@105 -- # continue 2 00:08:25.133 17:56:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:25.133 17:56:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:25.133 17:56:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:25.133 17:56:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:25.133 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:25.133 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:08:25.133 altname enp24s0f0np0 00:08:25.133 altname ens785f0np0 00:08:25.133 inet 192.168.100.8/24 scope global mlx_0_0 00:08:25.133 valid_lft forever preferred_lft forever 00:08:25.133 17:56:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:25.133 17:56:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:25.133 17:56:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:25.133 17:56:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:25.133 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:25.133 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:08:25.133 altname enp24s0f1np1 00:08:25.133 altname ens785f1np1 00:08:25.133 inet 192.168.100.9/24 scope global mlx_0_1 00:08:25.133 valid_lft forever preferred_lft forever 00:08:25.133 17:56:33 -- nvmf/common.sh@411 -- # return 0 00:08:25.133 17:56:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:25.133 17:56:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:25.133 17:56:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:25.133 17:56:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:25.133 17:56:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:25.133 17:56:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:25.133 17:56:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:25.133 17:56:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:25.133 17:56:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:25.133 17:56:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@105 -- # continue 2 00:08:25.133 17:56:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:25.133 17:56:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:25.133 17:56:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@105 -- # continue 2 00:08:25.133 17:56:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:25.133 17:56:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:25.133 17:56:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:25.133 17:56:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:25.133 17:56:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:25.133 17:56:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:25.133 192.168.100.9' 00:08:25.133 17:56:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:25.133 192.168.100.9' 00:08:25.134 17:56:33 -- nvmf/common.sh@446 -- # head -n 1 00:08:25.134 17:56:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:25.134 17:56:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:25.134 192.168.100.9' 00:08:25.134 17:56:33 -- nvmf/common.sh@447 -- # tail -n +2 00:08:25.134 17:56:33 -- nvmf/common.sh@447 -- # head -n 1 00:08:25.134 17:56:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:25.134 17:56:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:25.134 17:56:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:25.134 17:56:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:25.134 17:56:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:25.134 17:56:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:25.134 17:56:33 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:25.134 17:56:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:25.134 17:56:33 -- common/autotest_common.sh@720 -- # xtrace_disable 00:08:25.134 17:56:33 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 17:56:33 -- nvmf/common.sh@470 -- # nvmfpid=867875 00:08:25.134 17:56:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:25.134 17:56:33 -- nvmf/common.sh@471 -- # waitforlisten 867875 00:08:25.134 17:56:33 -- common/autotest_common.sh@827 -- # '[' -z 867875 ']' 00:08:25.134 17:56:33 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:25.134 17:56:33 -- common/autotest_common.sh@832 -- # local max_retries=100 00:08:25.134 17:56:33 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:25.134 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:25.134 17:56:33 -- common/autotest_common.sh@836 -- # xtrace_disable 00:08:25.134 17:56:33 -- common/autotest_common.sh@10 -- # set +x 00:08:25.134 [2024-04-26 17:56:33.921621] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:08:25.134 [2024-04-26 17:56:33.921688] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:25.134 EAL: No free 2048 kB hugepages reported on node 1 00:08:25.134 [2024-04-26 17:56:33.995022] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:25.134 [2024-04-26 17:56:34.077089] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:25.134 [2024-04-26 17:56:34.077128] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:25.134 [2024-04-26 17:56:34.077137] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:25.134 [2024-04-26 17:56:34.077145] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:25.134 [2024-04-26 17:56:34.077152] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:25.134 [2024-04-26 17:56:34.077201] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:25.134 [2024-04-26 17:56:34.077289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:25.134 [2024-04-26 17:56:34.077377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:25.134 [2024-04-26 17:56:34.077379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:25.703 17:56:34 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:08:25.703 17:56:34 -- common/autotest_common.sh@860 -- # return 0 00:08:25.703 17:56:34 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:25.703 17:56:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:08:25.703 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.703 17:56:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:25.703 17:56:34 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -c 0 00:08:25.703 17:56:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:25.703 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.703 [2024-04-26 17:56:34.784466] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:08:25.703 [2024-04-26 17:56:34.806074] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1e094d0/0x1e0d9c0) succeed. 00:08:25.703 [2024-04-26 17:56:34.816602] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1e0ab10/0x1e4f050) succeed. 00:08:25.962 17:56:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:25.962 17:56:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:25.962 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.962 17:56:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:25.962 17:56:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:25.962 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.962 17:56:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:25.962 17:56:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:25.962 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.962 17:56:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:08:25.962 17:56:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:08:25.962 17:56:34 -- common/autotest_common.sh@10 -- # set +x 00:08:25.962 [2024-04-26 17:56:34.964054] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:08:25.962 17:56:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@26 -- # '[' 0 -eq 1 ']' 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@31 -- # num_iterations=5 00:08:25.962 17:56:34 -- target/connect_disconnect.sh@34 -- # set +x 00:08:30.150 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.525 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.812 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.001 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.001 17:56:54 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:08:46.001 17:56:54 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:08:46.001 17:56:54 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:46.001 17:56:54 -- nvmf/common.sh@117 -- # sync 00:08:46.001 17:56:54 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:46.001 17:56:54 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:46.001 17:56:54 -- nvmf/common.sh@120 -- # set +e 00:08:46.001 17:56:54 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:46.001 17:56:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:46.001 rmmod nvme_rdma 00:08:46.001 rmmod nvme_fabrics 00:08:46.001 17:56:54 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:46.001 17:56:54 -- nvmf/common.sh@124 -- # set -e 00:08:46.001 17:56:54 -- nvmf/common.sh@125 -- # return 0 00:08:46.001 17:56:54 -- nvmf/common.sh@478 -- # '[' -n 867875 ']' 00:08:46.001 17:56:54 -- nvmf/common.sh@479 -- # killprocess 867875 00:08:46.001 17:56:54 -- common/autotest_common.sh@946 -- # '[' -z 867875 ']' 00:08:46.001 17:56:54 -- common/autotest_common.sh@950 -- # kill -0 867875 00:08:46.001 17:56:54 -- common/autotest_common.sh@951 -- # uname 00:08:46.001 17:56:54 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:46.001 17:56:54 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 867875 00:08:46.001 17:56:54 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:46.001 17:56:54 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:46.001 17:56:54 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 867875' 00:08:46.001 killing process with pid 867875 00:08:46.001 17:56:54 -- common/autotest_common.sh@965 -- # kill 867875 00:08:46.001 17:56:54 -- common/autotest_common.sh@970 -- # wait 867875 00:08:46.001 [2024-04-26 17:56:54.903997] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:08:46.001 17:56:55 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:46.001 17:56:55 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:46.001 00:08:46.001 real 0m27.580s 00:08:46.001 user 1m25.345s 00:08:46.001 sys 0m5.828s 00:08:46.001 17:56:55 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:46.001 17:56:55 -- common/autotest_common.sh@10 -- # set +x 00:08:46.001 ************************************ 00:08:46.001 END TEST nvmf_connect_disconnect 00:08:46.001 ************************************ 00:08:46.001 17:56:55 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:46.001 17:56:55 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:46.001 17:56:55 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:46.001 17:56:55 -- common/autotest_common.sh@10 -- # set +x 00:08:46.260 ************************************ 00:08:46.260 START TEST nvmf_multitarget 00:08:46.260 ************************************ 00:08:46.260 17:56:55 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=rdma 00:08:46.260 * Looking for test storage... 00:08:46.260 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:46.260 17:56:55 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:46.518 17:56:55 -- nvmf/common.sh@7 -- # uname -s 00:08:46.518 17:56:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:46.518 17:56:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:46.518 17:56:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:46.518 17:56:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:46.518 17:56:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:46.518 17:56:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:46.518 17:56:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:46.518 17:56:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:46.518 17:56:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:46.518 17:56:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:46.518 17:56:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:46.518 17:56:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:46.518 17:56:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:46.518 17:56:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:46.518 17:56:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:46.518 17:56:55 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:46.518 17:56:55 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:46.518 17:56:55 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:46.518 17:56:55 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:46.518 17:56:55 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:46.518 17:56:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.518 17:56:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.518 17:56:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.518 17:56:55 -- paths/export.sh@5 -- # export PATH 00:08:46.518 17:56:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:46.518 17:56:55 -- nvmf/common.sh@47 -- # : 0 00:08:46.518 17:56:55 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:46.518 17:56:55 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:46.518 17:56:55 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:46.518 17:56:55 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:46.518 17:56:55 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:46.518 17:56:55 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:46.518 17:56:55 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:46.518 17:56:55 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:46.518 17:56:55 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:08:46.518 17:56:55 -- target/multitarget.sh@15 -- # nvmftestinit 00:08:46.518 17:56:55 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:46.518 17:56:55 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:46.518 17:56:55 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:46.518 17:56:55 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:46.518 17:56:55 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:46.518 17:56:55 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:46.518 17:56:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:46.518 17:56:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:46.518 17:56:55 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:46.518 17:56:55 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:46.518 17:56:55 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:46.518 17:56:55 -- common/autotest_common.sh@10 -- # set +x 00:08:51.855 17:57:00 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:51.855 17:57:00 -- nvmf/common.sh@291 -- # pci_devs=() 00:08:51.855 17:57:00 -- nvmf/common.sh@291 -- # local -a pci_devs 00:08:51.855 17:57:00 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:08:51.855 17:57:00 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:08:51.855 17:57:00 -- nvmf/common.sh@293 -- # pci_drivers=() 00:08:51.855 17:57:00 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:08:51.855 17:57:00 -- nvmf/common.sh@295 -- # net_devs=() 00:08:51.855 17:57:00 -- nvmf/common.sh@295 -- # local -ga net_devs 00:08:51.855 17:57:00 -- nvmf/common.sh@296 -- # e810=() 00:08:51.855 17:57:00 -- nvmf/common.sh@296 -- # local -ga e810 00:08:51.855 17:57:00 -- nvmf/common.sh@297 -- # x722=() 00:08:51.855 17:57:00 -- nvmf/common.sh@297 -- # local -ga x722 00:08:51.855 17:57:00 -- nvmf/common.sh@298 -- # mlx=() 00:08:51.855 17:57:00 -- nvmf/common.sh@298 -- # local -ga mlx 00:08:51.855 17:57:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:51.855 17:57:00 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:08:51.855 17:57:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:51.855 17:57:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:08:51.855 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:08:51.855 17:57:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:51.855 17:57:00 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:08:51.855 17:57:00 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:08:51.855 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:08:51.855 17:57:00 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:08:51.855 17:57:00 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:08:51.855 17:57:00 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:51.855 17:57:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.855 17:57:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:51.855 17:57:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.855 17:57:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:08:51.855 Found net devices under 0000:18:00.0: mlx_0_0 00:08:51.855 17:57:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:08:51.855 17:57:00 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:51.855 17:57:00 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:08:51.855 17:57:00 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:51.855 17:57:00 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:08:51.855 Found net devices under 0000:18:00.1: mlx_0_1 00:08:51.855 17:57:00 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:08:51.855 17:57:00 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:08:51.855 17:57:00 -- nvmf/common.sh@403 -- # is_hw=yes 00:08:51.855 17:57:00 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:08:51.855 17:57:00 -- nvmf/common.sh@409 -- # rdma_device_init 00:08:51.855 17:57:00 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:08:51.856 17:57:00 -- nvmf/common.sh@58 -- # uname 00:08:51.856 17:57:00 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:08:51.856 17:57:00 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:08:51.856 17:57:00 -- nvmf/common.sh@63 -- # modprobe ib_core 00:08:51.856 17:57:00 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:08:51.856 17:57:00 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:08:51.856 17:57:00 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:08:51.856 17:57:00 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:08:51.856 17:57:00 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:08:51.856 17:57:00 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:08:51.856 17:57:00 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:08:51.856 17:57:00 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:08:51.856 17:57:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:51.856 17:57:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:51.856 17:57:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:51.856 17:57:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:51.856 17:57:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:51.856 17:57:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@105 -- # continue 2 00:08:51.856 17:57:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@105 -- # continue 2 00:08:51.856 17:57:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:51.856 17:57:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:51.856 17:57:00 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:08:51.856 17:57:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:08:51.856 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:51.856 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:08:51.856 altname enp24s0f0np0 00:08:51.856 altname ens785f0np0 00:08:51.856 inet 192.168.100.8/24 scope global mlx_0_0 00:08:51.856 valid_lft forever preferred_lft forever 00:08:51.856 17:57:00 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:08:51.856 17:57:00 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:51.856 17:57:00 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:08:51.856 17:57:00 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:08:51.856 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:08:51.856 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:08:51.856 altname enp24s0f1np1 00:08:51.856 altname ens785f1np1 00:08:51.856 inet 192.168.100.9/24 scope global mlx_0_1 00:08:51.856 valid_lft forever preferred_lft forever 00:08:51.856 17:57:00 -- nvmf/common.sh@411 -- # return 0 00:08:51.856 17:57:00 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:08:51.856 17:57:00 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:08:51.856 17:57:00 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:08:51.856 17:57:00 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:08:51.856 17:57:00 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:08:51.856 17:57:00 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:08:51.856 17:57:00 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:08:51.856 17:57:00 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:08:51.856 17:57:00 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:08:51.856 17:57:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@105 -- # continue 2 00:08:51.856 17:57:00 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:08:51.856 17:57:00 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:08:51.856 17:57:00 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@105 -- # continue 2 00:08:51.856 17:57:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:51.856 17:57:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:51.856 17:57:00 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:08:51.856 17:57:00 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:08:51.856 17:57:00 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:08:51.856 17:57:00 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:08:51.856 192.168.100.9' 00:08:51.856 17:57:00 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:08:51.856 192.168.100.9' 00:08:51.856 17:57:00 -- nvmf/common.sh@446 -- # head -n 1 00:08:51.856 17:57:00 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:08:51.856 17:57:00 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:08:51.856 192.168.100.9' 00:08:51.856 17:57:00 -- nvmf/common.sh@447 -- # tail -n +2 00:08:51.856 17:57:00 -- nvmf/common.sh@447 -- # head -n 1 00:08:51.856 17:57:00 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:08:51.856 17:57:00 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:08:51.856 17:57:00 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:08:51.856 17:57:00 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:08:51.856 17:57:00 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:08:51.856 17:57:00 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:08:51.856 17:57:00 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:08:51.856 17:57:00 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:08:51.856 17:57:00 -- common/autotest_common.sh@720 -- # xtrace_disable 00:08:51.856 17:57:00 -- common/autotest_common.sh@10 -- # set +x 00:08:51.856 17:57:00 -- nvmf/common.sh@470 -- # nvmfpid=873545 00:08:51.856 17:57:00 -- nvmf/common.sh@471 -- # waitforlisten 873545 00:08:51.856 17:57:00 -- common/autotest_common.sh@827 -- # '[' -z 873545 ']' 00:08:51.856 17:57:00 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:51.856 17:57:00 -- common/autotest_common.sh@832 -- # local max_retries=100 00:08:51.856 17:57:00 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:51.856 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:51.856 17:57:00 -- common/autotest_common.sh@836 -- # xtrace_disable 00:08:51.856 17:57:00 -- common/autotest_common.sh@10 -- # set +x 00:08:51.856 17:57:00 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:51.856 [2024-04-26 17:57:01.005939] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:08:51.856 [2024-04-26 17:57:01.006002] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:51.856 EAL: No free 2048 kB hugepages reported on node 1 00:08:52.116 [2024-04-26 17:57:01.076973] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:52.116 [2024-04-26 17:57:01.165824] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:52.116 [2024-04-26 17:57:01.165870] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:52.116 [2024-04-26 17:57:01.165879] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:08:52.116 [2024-04-26 17:57:01.165888] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:08:52.116 [2024-04-26 17:57:01.165895] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:52.116 [2024-04-26 17:57:01.165987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:52.116 [2024-04-26 17:57:01.166076] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:52.116 [2024-04-26 17:57:01.166156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:52.116 [2024-04-26 17:57:01.166158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:52.683 17:57:01 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:08:52.683 17:57:01 -- common/autotest_common.sh@860 -- # return 0 00:08:52.683 17:57:01 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:08:52.683 17:57:01 -- common/autotest_common.sh@726 -- # xtrace_disable 00:08:52.683 17:57:01 -- common/autotest_common.sh@10 -- # set +x 00:08:52.683 17:57:01 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:52.684 17:57:01 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:08:52.684 17:57:01 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:52.684 17:57:01 -- target/multitarget.sh@21 -- # jq length 00:08:52.942 17:57:01 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:08:52.942 17:57:01 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:08:52.942 "nvmf_tgt_1" 00:08:52.942 17:57:02 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:08:53.201 "nvmf_tgt_2" 00:08:53.201 17:57:02 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:53.201 17:57:02 -- target/multitarget.sh@28 -- # jq length 00:08:53.201 17:57:02 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:08:53.201 17:57:02 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:08:53.201 true 00:08:53.459 17:57:02 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:08:53.459 true 00:08:53.459 17:57:02 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:08:53.459 17:57:02 -- target/multitarget.sh@35 -- # jq length 00:08:53.459 17:57:02 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:08:53.459 17:57:02 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:08:53.459 17:57:02 -- target/multitarget.sh@41 -- # nvmftestfini 00:08:53.459 17:57:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:08:53.459 17:57:02 -- nvmf/common.sh@117 -- # sync 00:08:53.459 17:57:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:08:53.459 17:57:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:08:53.459 17:57:02 -- nvmf/common.sh@120 -- # set +e 00:08:53.459 17:57:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:08:53.459 17:57:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:08:53.459 rmmod nvme_rdma 00:08:53.459 rmmod nvme_fabrics 00:08:53.719 17:57:02 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:08:53.719 17:57:02 -- nvmf/common.sh@124 -- # set -e 00:08:53.719 17:57:02 -- nvmf/common.sh@125 -- # return 0 00:08:53.719 17:57:02 -- nvmf/common.sh@478 -- # '[' -n 873545 ']' 00:08:53.719 17:57:02 -- nvmf/common.sh@479 -- # killprocess 873545 00:08:53.719 17:57:02 -- common/autotest_common.sh@946 -- # '[' -z 873545 ']' 00:08:53.719 17:57:02 -- common/autotest_common.sh@950 -- # kill -0 873545 00:08:53.719 17:57:02 -- common/autotest_common.sh@951 -- # uname 00:08:53.719 17:57:02 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:08:53.719 17:57:02 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 873545 00:08:53.719 17:57:02 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:08:53.719 17:57:02 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:08:53.719 17:57:02 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 873545' 00:08:53.719 killing process with pid 873545 00:08:53.719 17:57:02 -- common/autotest_common.sh@965 -- # kill 873545 00:08:53.719 17:57:02 -- common/autotest_common.sh@970 -- # wait 873545 00:08:53.978 17:57:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:08:53.978 17:57:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:08:53.978 00:08:53.978 real 0m7.590s 00:08:53.978 user 0m9.223s 00:08:53.978 sys 0m4.674s 00:08:53.978 17:57:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:08:53.978 17:57:02 -- common/autotest_common.sh@10 -- # set +x 00:08:53.978 ************************************ 00:08:53.978 END TEST nvmf_multitarget 00:08:53.978 ************************************ 00:08:53.978 17:57:02 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:53.978 17:57:02 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:08:53.978 17:57:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:08:53.978 17:57:02 -- common/autotest_common.sh@10 -- # set +x 00:08:53.979 ************************************ 00:08:53.979 START TEST nvmf_rpc 00:08:53.979 ************************************ 00:08:53.979 17:57:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=rdma 00:08:54.240 * Looking for test storage... 00:08:54.240 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:08:54.241 17:57:03 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:08:54.241 17:57:03 -- nvmf/common.sh@7 -- # uname -s 00:08:54.241 17:57:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:54.241 17:57:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:54.241 17:57:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:54.241 17:57:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:54.241 17:57:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:54.241 17:57:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:54.241 17:57:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:54.241 17:57:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:54.241 17:57:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:54.241 17:57:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:54.241 17:57:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:08:54.241 17:57:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:08:54.241 17:57:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:54.241 17:57:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:54.241 17:57:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:54.241 17:57:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:08:54.241 17:57:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:08:54.241 17:57:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:54.241 17:57:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:54.241 17:57:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:54.241 17:57:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.241 17:57:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.241 17:57:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.241 17:57:03 -- paths/export.sh@5 -- # export PATH 00:08:54.241 17:57:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.241 17:57:03 -- nvmf/common.sh@47 -- # : 0 00:08:54.241 17:57:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:08:54.241 17:57:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:08:54.241 17:57:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:08:54.241 17:57:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:54.241 17:57:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:54.241 17:57:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:08:54.241 17:57:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:08:54.241 17:57:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:08:54.241 17:57:03 -- target/rpc.sh@11 -- # loops=5 00:08:54.241 17:57:03 -- target/rpc.sh@23 -- # nvmftestinit 00:08:54.241 17:57:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:08:54.241 17:57:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:54.241 17:57:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:08:54.241 17:57:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:08:54.241 17:57:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:08:54.241 17:57:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:54.241 17:57:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:54.241 17:57:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:54.241 17:57:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:08:54.241 17:57:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:08:54.241 17:57:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:08:54.241 17:57:03 -- common/autotest_common.sh@10 -- # set +x 00:09:00.812 17:57:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:00.812 17:57:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:00.812 17:57:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:00.812 17:57:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:00.812 17:57:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:00.812 17:57:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:00.812 17:57:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:00.812 17:57:09 -- nvmf/common.sh@295 -- # net_devs=() 00:09:00.812 17:57:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:00.812 17:57:09 -- nvmf/common.sh@296 -- # e810=() 00:09:00.812 17:57:09 -- nvmf/common.sh@296 -- # local -ga e810 00:09:00.812 17:57:09 -- nvmf/common.sh@297 -- # x722=() 00:09:00.812 17:57:09 -- nvmf/common.sh@297 -- # local -ga x722 00:09:00.812 17:57:09 -- nvmf/common.sh@298 -- # mlx=() 00:09:00.812 17:57:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:00.812 17:57:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:00.812 17:57:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:00.812 17:57:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:00.812 17:57:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:00.812 17:57:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:00.812 17:57:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:00.812 17:57:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:00.812 17:57:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:00.812 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:00.812 17:57:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:00.812 17:57:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:00.812 17:57:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:00.812 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:00.812 17:57:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:00.812 17:57:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:00.812 17:57:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:00.812 17:57:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:00.812 17:57:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.812 17:57:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:00.813 17:57:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.813 17:57:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:00.813 Found net devices under 0000:18:00.0: mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.813 17:57:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:00.813 17:57:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:00.813 17:57:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:00.813 17:57:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:00.813 Found net devices under 0000:18:00.1: mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:00.813 17:57:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:00.813 17:57:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:00.813 17:57:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:00.813 17:57:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:00.813 17:57:09 -- nvmf/common.sh@58 -- # uname 00:09:00.813 17:57:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:00.813 17:57:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:00.813 17:57:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:00.813 17:57:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:00.813 17:57:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:00.813 17:57:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:00.813 17:57:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:00.813 17:57:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:00.813 17:57:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:00.813 17:57:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:00.813 17:57:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:00.813 17:57:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:00.813 17:57:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:00.813 17:57:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:00.813 17:57:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:00.813 17:57:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:00.813 17:57:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@105 -- # continue 2 00:09:00.813 17:57:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@105 -- # continue 2 00:09:00.813 17:57:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:00.813 17:57:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:00.813 17:57:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:00.813 17:57:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:00.813 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:00.813 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:00.813 altname enp24s0f0np0 00:09:00.813 altname ens785f0np0 00:09:00.813 inet 192.168.100.8/24 scope global mlx_0_0 00:09:00.813 valid_lft forever preferred_lft forever 00:09:00.813 17:57:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:00.813 17:57:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:00.813 17:57:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:00.813 17:57:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:00.813 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:00.813 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:00.813 altname enp24s0f1np1 00:09:00.813 altname ens785f1np1 00:09:00.813 inet 192.168.100.9/24 scope global mlx_0_1 00:09:00.813 valid_lft forever preferred_lft forever 00:09:00.813 17:57:09 -- nvmf/common.sh@411 -- # return 0 00:09:00.813 17:57:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:00.813 17:57:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:00.813 17:57:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:00.813 17:57:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:00.813 17:57:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:00.813 17:57:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:00.813 17:57:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:00.813 17:57:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:00.813 17:57:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:00.813 17:57:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@105 -- # continue 2 00:09:00.813 17:57:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:00.813 17:57:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:00.813 17:57:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@105 -- # continue 2 00:09:00.813 17:57:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:00.813 17:57:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:00.813 17:57:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:00.813 17:57:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:00.813 17:57:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:00.813 17:57:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:00.813 192.168.100.9' 00:09:00.813 17:57:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:00.813 192.168.100.9' 00:09:00.813 17:57:09 -- nvmf/common.sh@446 -- # head -n 1 00:09:00.813 17:57:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:00.813 17:57:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:00.813 192.168.100.9' 00:09:00.813 17:57:09 -- nvmf/common.sh@447 -- # tail -n +2 00:09:00.813 17:57:09 -- nvmf/common.sh@447 -- # head -n 1 00:09:00.813 17:57:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:00.813 17:57:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:00.813 17:57:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:00.813 17:57:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:00.813 17:57:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:00.813 17:57:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:00.813 17:57:09 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:09:00.813 17:57:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:00.813 17:57:09 -- common/autotest_common.sh@720 -- # xtrace_disable 00:09:00.813 17:57:09 -- common/autotest_common.sh@10 -- # set +x 00:09:00.813 17:57:09 -- nvmf/common.sh@470 -- # nvmfpid=877264 00:09:00.813 17:57:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:00.813 17:57:09 -- nvmf/common.sh@471 -- # waitforlisten 877264 00:09:00.813 17:57:09 -- common/autotest_common.sh@827 -- # '[' -z 877264 ']' 00:09:00.813 17:57:09 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:00.813 17:57:09 -- common/autotest_common.sh@832 -- # local max_retries=100 00:09:00.813 17:57:09 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:00.813 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:00.813 17:57:09 -- common/autotest_common.sh@836 -- # xtrace_disable 00:09:00.813 17:57:09 -- common/autotest_common.sh@10 -- # set +x 00:09:00.813 [2024-04-26 17:57:09.705250] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:09:00.813 [2024-04-26 17:57:09.705306] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:00.813 EAL: No free 2048 kB hugepages reported on node 1 00:09:00.813 [2024-04-26 17:57:09.778809] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:00.813 [2024-04-26 17:57:09.857917] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:00.813 [2024-04-26 17:57:09.857966] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:00.813 [2024-04-26 17:57:09.857976] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:00.813 [2024-04-26 17:57:09.857984] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:00.813 [2024-04-26 17:57:09.857991] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:00.813 [2024-04-26 17:57:09.858085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:00.813 [2024-04-26 17:57:09.858182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:00.813 [2024-04-26 17:57:09.858260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:00.813 [2024-04-26 17:57:09.858261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:01.382 17:57:10 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:09:01.382 17:57:10 -- common/autotest_common.sh@860 -- # return 0 00:09:01.382 17:57:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:01.382 17:57:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:09:01.382 17:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:01.641 17:57:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:01.641 17:57:10 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:09:01.641 17:57:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:01.641 17:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:01.641 17:57:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:01.641 17:57:10 -- target/rpc.sh@26 -- # stats='{ 00:09:01.641 "tick_rate": 2300000000, 00:09:01.641 "poll_groups": [ 00:09:01.641 { 00:09:01.641 "name": "nvmf_tgt_poll_group_0", 00:09:01.641 "admin_qpairs": 0, 00:09:01.641 "io_qpairs": 0, 00:09:01.641 "current_admin_qpairs": 0, 00:09:01.641 "current_io_qpairs": 0, 00:09:01.641 "pending_bdev_io": 0, 00:09:01.641 "completed_nvme_io": 0, 00:09:01.641 "transports": [] 00:09:01.641 }, 00:09:01.641 { 00:09:01.641 "name": "nvmf_tgt_poll_group_1", 00:09:01.641 "admin_qpairs": 0, 00:09:01.641 "io_qpairs": 0, 00:09:01.641 "current_admin_qpairs": 0, 00:09:01.641 "current_io_qpairs": 0, 00:09:01.641 "pending_bdev_io": 0, 00:09:01.641 "completed_nvme_io": 0, 00:09:01.641 "transports": [] 00:09:01.641 }, 00:09:01.641 { 00:09:01.641 "name": "nvmf_tgt_poll_group_2", 00:09:01.641 "admin_qpairs": 0, 00:09:01.641 "io_qpairs": 0, 00:09:01.641 "current_admin_qpairs": 0, 00:09:01.641 "current_io_qpairs": 0, 00:09:01.641 "pending_bdev_io": 0, 00:09:01.641 "completed_nvme_io": 0, 00:09:01.641 "transports": [] 00:09:01.641 }, 00:09:01.641 { 00:09:01.641 "name": "nvmf_tgt_poll_group_3", 00:09:01.641 "admin_qpairs": 0, 00:09:01.641 "io_qpairs": 0, 00:09:01.641 "current_admin_qpairs": 0, 00:09:01.641 "current_io_qpairs": 0, 00:09:01.641 "pending_bdev_io": 0, 00:09:01.641 "completed_nvme_io": 0, 00:09:01.641 "transports": [] 00:09:01.641 } 00:09:01.641 ] 00:09:01.641 }' 00:09:01.641 17:57:10 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:09:01.641 17:57:10 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:09:01.641 17:57:10 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:09:01.641 17:57:10 -- target/rpc.sh@15 -- # wc -l 00:09:01.641 17:57:10 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:09:01.641 17:57:10 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:09:01.641 17:57:10 -- target/rpc.sh@29 -- # [[ null == null ]] 00:09:01.641 17:57:10 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:01.641 17:57:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:01.641 17:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:01.641 [2024-04-26 17:57:10.739280] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1305530/0x1309a20) succeed. 00:09:01.641 [2024-04-26 17:57:10.749819] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1306b70/0x134b0b0) succeed. 00:09:01.900 17:57:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:01.900 17:57:10 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:09:01.900 17:57:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:01.900 17:57:10 -- common/autotest_common.sh@10 -- # set +x 00:09:01.900 17:57:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:01.900 17:57:10 -- target/rpc.sh@33 -- # stats='{ 00:09:01.900 "tick_rate": 2300000000, 00:09:01.900 "poll_groups": [ 00:09:01.900 { 00:09:01.900 "name": "nvmf_tgt_poll_group_0", 00:09:01.900 "admin_qpairs": 0, 00:09:01.900 "io_qpairs": 0, 00:09:01.900 "current_admin_qpairs": 0, 00:09:01.900 "current_io_qpairs": 0, 00:09:01.900 "pending_bdev_io": 0, 00:09:01.900 "completed_nvme_io": 0, 00:09:01.900 "transports": [ 00:09:01.900 { 00:09:01.900 "trtype": "RDMA", 00:09:01.900 "pending_data_buffer": 0, 00:09:01.900 "devices": [ 00:09:01.900 { 00:09:01.900 "name": "mlx5_0", 00:09:01.900 "polls": 16279, 00:09:01.900 "idle_polls": 16279, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "mlx5_1", 00:09:01.900 "polls": 16279, 00:09:01.900 "idle_polls": 16279, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "nvmf_tgt_poll_group_1", 00:09:01.900 "admin_qpairs": 0, 00:09:01.900 "io_qpairs": 0, 00:09:01.900 "current_admin_qpairs": 0, 00:09:01.900 "current_io_qpairs": 0, 00:09:01.900 "pending_bdev_io": 0, 00:09:01.900 "completed_nvme_io": 0, 00:09:01.900 "transports": [ 00:09:01.900 { 00:09:01.900 "trtype": "RDMA", 00:09:01.900 "pending_data_buffer": 0, 00:09:01.900 "devices": [ 00:09:01.900 { 00:09:01.900 "name": "mlx5_0", 00:09:01.900 "polls": 10422, 00:09:01.900 "idle_polls": 10422, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "mlx5_1", 00:09:01.900 "polls": 10422, 00:09:01.900 "idle_polls": 10422, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "nvmf_tgt_poll_group_2", 00:09:01.900 "admin_qpairs": 0, 00:09:01.900 "io_qpairs": 0, 00:09:01.900 "current_admin_qpairs": 0, 00:09:01.900 "current_io_qpairs": 0, 00:09:01.900 "pending_bdev_io": 0, 00:09:01.900 "completed_nvme_io": 0, 00:09:01.900 "transports": [ 00:09:01.900 { 00:09:01.900 "trtype": "RDMA", 00:09:01.900 "pending_data_buffer": 0, 00:09:01.900 "devices": [ 00:09:01.900 { 00:09:01.900 "name": "mlx5_0", 00:09:01.900 "polls": 5599, 00:09:01.900 "idle_polls": 5599, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "mlx5_1", 00:09:01.900 "polls": 5599, 00:09:01.900 "idle_polls": 5599, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "nvmf_tgt_poll_group_3", 00:09:01.900 "admin_qpairs": 0, 00:09:01.900 "io_qpairs": 0, 00:09:01.900 "current_admin_qpairs": 0, 00:09:01.900 "current_io_qpairs": 0, 00:09:01.900 "pending_bdev_io": 0, 00:09:01.900 "completed_nvme_io": 0, 00:09:01.900 "transports": [ 00:09:01.900 { 00:09:01.900 "trtype": "RDMA", 00:09:01.900 "pending_data_buffer": 0, 00:09:01.900 "devices": [ 00:09:01.900 { 00:09:01.900 "name": "mlx5_0", 00:09:01.900 "polls": 886, 00:09:01.900 "idle_polls": 886, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 }, 00:09:01.900 { 00:09:01.900 "name": "mlx5_1", 00:09:01.900 "polls": 886, 00:09:01.900 "idle_polls": 886, 00:09:01.900 "completions": 0, 00:09:01.900 "requests": 0, 00:09:01.900 "request_latency": 0, 00:09:01.900 "pending_free_request": 0, 00:09:01.900 "pending_rdma_read": 0, 00:09:01.900 "pending_rdma_write": 0, 00:09:01.900 "pending_rdma_send": 0, 00:09:01.900 "total_send_wrs": 0, 00:09:01.900 "send_doorbell_updates": 0, 00:09:01.900 "total_recv_wrs": 4096, 00:09:01.900 "recv_doorbell_updates": 1 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 } 00:09:01.900 ] 00:09:01.900 }' 00:09:01.900 17:57:10 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:01.900 17:57:10 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:09:01.900 17:57:10 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:09:01.900 17:57:10 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:01.900 17:57:11 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:09:01.900 17:57:11 -- target/rpc.sh@38 -- # '[' rdma == rdma ']' 00:09:01.900 17:57:11 -- target/rpc.sh@40 -- # jcount '.poll_groups[0].transports[].trtype' 00:09:01.900 17:57:11 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[].trtype' 00:09:01.900 17:57:11 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[].trtype' 00:09:01.900 17:57:11 -- target/rpc.sh@15 -- # wc -l 00:09:01.900 17:57:11 -- target/rpc.sh@40 -- # (( 1 == 1 )) 00:09:01.900 17:57:11 -- target/rpc.sh@41 -- # jq -r '.poll_groups[0].transports[0].trtype' 00:09:02.159 17:57:11 -- target/rpc.sh@41 -- # transport_type=RDMA 00:09:02.159 17:57:11 -- target/rpc.sh@42 -- # [[ rdma == \r\d\m\a ]] 00:09:02.159 17:57:11 -- target/rpc.sh@43 -- # jcount '.poll_groups[0].transports[0].devices[].name' 00:09:02.159 17:57:11 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[0].transports[0].devices[].name' 00:09:02.159 17:57:11 -- target/rpc.sh@15 -- # jq '.poll_groups[0].transports[0].devices[].name' 00:09:02.159 17:57:11 -- target/rpc.sh@15 -- # wc -l 00:09:02.159 17:57:11 -- target/rpc.sh@43 -- # (( 2 > 0 )) 00:09:02.159 17:57:11 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:09:02.159 17:57:11 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:09:02.159 17:57:11 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 Malloc1 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 [2024-04-26 17:57:11.198619] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@58 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:09:02.159 17:57:11 -- common/autotest_common.sh@648 -- # local es=0 00:09:02.159 17:57:11 -- common/autotest_common.sh@650 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:09:02.159 17:57:11 -- common/autotest_common.sh@636 -- # local arg=nvme 00:09:02.159 17:57:11 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:02.159 17:57:11 -- common/autotest_common.sh@640 -- # type -t nvme 00:09:02.159 17:57:11 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:02.159 17:57:11 -- common/autotest_common.sh@642 -- # type -P nvme 00:09:02.159 17:57:11 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:02.159 17:57:11 -- common/autotest_common.sh@642 -- # arg=/usr/sbin/nvme 00:09:02.159 17:57:11 -- common/autotest_common.sh@642 -- # [[ -x /usr/sbin/nvme ]] 00:09:02.159 17:57:11 -- common/autotest_common.sh@651 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -s 4420 00:09:02.159 [2024-04-26 17:57:11.248467] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562' 00:09:02.159 Failed to write to /dev/nvme-fabrics: Input/output error 00:09:02.159 could not add new controller: failed to write to nvme-fabrics device 00:09:02.159 17:57:11 -- common/autotest_common.sh@651 -- # es=1 00:09:02.159 17:57:11 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:09:02.159 17:57:11 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:09:02.159 17:57:11 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:09:02.159 17:57:11 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:02.159 17:57:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:02.159 17:57:11 -- common/autotest_common.sh@10 -- # set +x 00:09:02.159 17:57:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:02.159 17:57:11 -- target/rpc.sh@62 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:03.093 17:57:12 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:09:03.093 17:57:12 -- common/autotest_common.sh@1194 -- # local i=0 00:09:03.093 17:57:12 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:03.093 17:57:12 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:03.093 17:57:12 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:05.622 17:57:14 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:05.622 17:57:14 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:05.622 17:57:14 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:05.622 17:57:14 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:05.622 17:57:14 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:05.622 17:57:14 -- common/autotest_common.sh@1204 -- # return 0 00:09:05.622 17:57:14 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:06.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.189 17:57:15 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:06.189 17:57:15 -- common/autotest_common.sh@1215 -- # local i=0 00:09:06.189 17:57:15 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:06.189 17:57:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:06.189 17:57:15 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:06.189 17:57:15 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:06.189 17:57:15 -- common/autotest_common.sh@1227 -- # return 0 00:09:06.189 17:57:15 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:06.189 17:57:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.189 17:57:15 -- common/autotest_common.sh@10 -- # set +x 00:09:06.189 17:57:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.189 17:57:15 -- target/rpc.sh@69 -- # NOT nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:06.189 17:57:15 -- common/autotest_common.sh@648 -- # local es=0 00:09:06.189 17:57:15 -- common/autotest_common.sh@650 -- # valid_exec_arg nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:06.189 17:57:15 -- common/autotest_common.sh@636 -- # local arg=nvme 00:09:06.189 17:57:15 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.189 17:57:15 -- common/autotest_common.sh@640 -- # type -t nvme 00:09:06.189 17:57:15 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.189 17:57:15 -- common/autotest_common.sh@642 -- # type -P nvme 00:09:06.189 17:57:15 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:09:06.189 17:57:15 -- common/autotest_common.sh@642 -- # arg=/usr/sbin/nvme 00:09:06.189 17:57:15 -- common/autotest_common.sh@642 -- # [[ -x /usr/sbin/nvme ]] 00:09:06.189 17:57:15 -- common/autotest_common.sh@651 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:06.189 [2024-04-26 17:57:15.300327] ctrlr.c: 766:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562' 00:09:06.189 Failed to write to /dev/nvme-fabrics: Input/output error 00:09:06.189 could not add new controller: failed to write to nvme-fabrics device 00:09:06.189 17:57:15 -- common/autotest_common.sh@651 -- # es=1 00:09:06.189 17:57:15 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:09:06.189 17:57:15 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:09:06.189 17:57:15 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:09:06.189 17:57:15 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:09:06.189 17:57:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:06.189 17:57:15 -- common/autotest_common.sh@10 -- # set +x 00:09:06.189 17:57:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:06.189 17:57:15 -- target/rpc.sh@73 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:07.566 17:57:16 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:09:07.566 17:57:16 -- common/autotest_common.sh@1194 -- # local i=0 00:09:07.566 17:57:16 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:07.566 17:57:16 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:07.566 17:57:16 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:09.471 17:57:18 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:09.471 17:57:18 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:09.471 17:57:18 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:09.471 17:57:18 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:09.471 17:57:18 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:09.471 17:57:18 -- common/autotest_common.sh@1204 -- # return 0 00:09:09.471 17:57:18 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:10.408 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.408 17:57:19 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:10.408 17:57:19 -- common/autotest_common.sh@1215 -- # local i=0 00:09:10.408 17:57:19 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:10.408 17:57:19 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:10.408 17:57:19 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:10.408 17:57:19 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:10.408 17:57:19 -- common/autotest_common.sh@1227 -- # return 0 00:09:10.408 17:57:19 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:10.408 17:57:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:10.408 17:57:19 -- common/autotest_common.sh@10 -- # set +x 00:09:10.408 17:57:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:10.408 17:57:19 -- target/rpc.sh@81 -- # seq 1 5 00:09:10.408 17:57:19 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:10.408 17:57:19 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:10.408 17:57:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:10.408 17:57:19 -- common/autotest_common.sh@10 -- # set +x 00:09:10.408 17:57:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:10.408 17:57:19 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:10.408 17:57:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:10.408 17:57:19 -- common/autotest_common.sh@10 -- # set +x 00:09:10.408 [2024-04-26 17:57:19.354702] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:10.408 17:57:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:10.408 17:57:19 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:10.408 17:57:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:10.408 17:57:19 -- common/autotest_common.sh@10 -- # set +x 00:09:10.408 17:57:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:10.408 17:57:19 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:10.408 17:57:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:10.408 17:57:19 -- common/autotest_common.sh@10 -- # set +x 00:09:10.408 17:57:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:10.408 17:57:19 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:11.383 17:57:20 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:11.383 17:57:20 -- common/autotest_common.sh@1194 -- # local i=0 00:09:11.383 17:57:20 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:11.383 17:57:20 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:11.383 17:57:20 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:13.282 17:57:22 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:13.282 17:57:22 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:13.282 17:57:22 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:13.282 17:57:22 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:13.282 17:57:22 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:13.282 17:57:22 -- common/autotest_common.sh@1204 -- # return 0 00:09:13.282 17:57:22 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:14.218 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.218 17:57:23 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:14.218 17:57:23 -- common/autotest_common.sh@1215 -- # local i=0 00:09:14.218 17:57:23 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:14.218 17:57:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:14.219 17:57:23 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:14.219 17:57:23 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:14.219 17:57:23 -- common/autotest_common.sh@1227 -- # return 0 00:09:14.219 17:57:23 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:14.219 17:57:23 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 [2024-04-26 17:57:23.366254] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:14.219 17:57:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:14.219 17:57:23 -- common/autotest_common.sh@10 -- # set +x 00:09:14.219 17:57:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:14.219 17:57:23 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:15.599 17:57:24 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:15.599 17:57:24 -- common/autotest_common.sh@1194 -- # local i=0 00:09:15.599 17:57:24 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:15.599 17:57:24 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:15.599 17:57:24 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:17.522 17:57:26 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:17.522 17:57:26 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:17.522 17:57:26 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:17.522 17:57:26 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:17.522 17:57:26 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:17.522 17:57:26 -- common/autotest_common.sh@1204 -- # return 0 00:09:17.522 17:57:26 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:18.149 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.149 17:57:27 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:18.150 17:57:27 -- common/autotest_common.sh@1215 -- # local i=0 00:09:18.150 17:57:27 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:18.150 17:57:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.150 17:57:27 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:18.150 17:57:27 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:18.407 17:57:27 -- common/autotest_common.sh@1227 -- # return 0 00:09:18.407 17:57:27 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:18.407 17:57:27 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 [2024-04-26 17:57:27.378836] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:18.407 17:57:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:18.407 17:57:27 -- common/autotest_common.sh@10 -- # set +x 00:09:18.407 17:57:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:18.407 17:57:27 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:19.339 17:57:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:19.339 17:57:28 -- common/autotest_common.sh@1194 -- # local i=0 00:09:19.339 17:57:28 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:19.339 17:57:28 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:19.339 17:57:28 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:21.241 17:57:30 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:21.241 17:57:30 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:21.241 17:57:30 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:21.241 17:57:30 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:21.241 17:57:30 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:21.241 17:57:30 -- common/autotest_common.sh@1204 -- # return 0 00:09:21.241 17:57:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:22.177 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.177 17:57:31 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:22.177 17:57:31 -- common/autotest_common.sh@1215 -- # local i=0 00:09:22.177 17:57:31 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:22.177 17:57:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:22.177 17:57:31 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:22.177 17:57:31 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:22.436 17:57:31 -- common/autotest_common.sh@1227 -- # return 0 00:09:22.436 17:57:31 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:22.436 17:57:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 [2024-04-26 17:57:31.405591] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:22.436 17:57:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:22.436 17:57:31 -- common/autotest_common.sh@10 -- # set +x 00:09:22.436 17:57:31 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:22.436 17:57:31 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:23.371 17:57:32 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:23.371 17:57:32 -- common/autotest_common.sh@1194 -- # local i=0 00:09:23.371 17:57:32 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:23.371 17:57:32 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:23.371 17:57:32 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:25.274 17:57:34 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:25.274 17:57:34 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:25.274 17:57:34 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:25.274 17:57:34 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:25.274 17:57:34 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:25.274 17:57:34 -- common/autotest_common.sh@1204 -- # return 0 00:09:25.274 17:57:34 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:26.211 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.211 17:57:35 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:26.211 17:57:35 -- common/autotest_common.sh@1215 -- # local i=0 00:09:26.211 17:57:35 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:26.211 17:57:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:26.211 17:57:35 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:26.211 17:57:35 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:26.469 17:57:35 -- common/autotest_common.sh@1227 -- # return 0 00:09:26.469 17:57:35 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:09:26.469 17:57:35 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 [2024-04-26 17:57:35.439699] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:26.469 17:57:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:26.469 17:57:35 -- common/autotest_common.sh@10 -- # set +x 00:09:26.469 17:57:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:26.469 17:57:35 -- target/rpc.sh@86 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:09:27.403 17:57:36 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:09:27.403 17:57:36 -- common/autotest_common.sh@1194 -- # local i=0 00:09:27.403 17:57:36 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:09:27.403 17:57:36 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:09:27.403 17:57:36 -- common/autotest_common.sh@1201 -- # sleep 2 00:09:29.305 17:57:38 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:09:29.305 17:57:38 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:09:29.305 17:57:38 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:09:29.305 17:57:38 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:09:29.305 17:57:38 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:09:29.305 17:57:38 -- common/autotest_common.sh@1204 -- # return 0 00:09:29.305 17:57:38 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:09:30.244 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.244 17:57:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:09:30.244 17:57:39 -- common/autotest_common.sh@1215 -- # local i=0 00:09:30.244 17:57:39 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:09:30.244 17:57:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:30.244 17:57:39 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:09:30.244 17:57:39 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:09:30.244 17:57:39 -- common/autotest_common.sh@1227 -- # return 0 00:09:30.244 17:57:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:09:30.244 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.244 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.244 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.244 17:57:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.244 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.244 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # seq 1 5 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:30.502 17:57:39 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 [2024-04-26 17:57:39.462283] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:30.502 17:57:39 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 [2024-04-26 17:57:39.510552] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:30.502 17:57:39 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 [2024-04-26 17:57:39.558718] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:30.502 17:57:39 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 [2024-04-26 17:57:39.606895] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:09:30.502 17:57:39 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 [2024-04-26 17:57:39.654998] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.502 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.502 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.502 17:57:39 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:09:30.502 17:57:39 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:30.760 17:57:39 -- common/autotest_common.sh@10 -- # set +x 00:09:30.760 17:57:39 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:30.760 17:57:39 -- target/rpc.sh@110 -- # stats='{ 00:09:30.760 "tick_rate": 2300000000, 00:09:30.760 "poll_groups": [ 00:09:30.760 { 00:09:30.760 "name": "nvmf_tgt_poll_group_0", 00:09:30.760 "admin_qpairs": 2, 00:09:30.760 "io_qpairs": 27, 00:09:30.760 "current_admin_qpairs": 0, 00:09:30.760 "current_io_qpairs": 0, 00:09:30.760 "pending_bdev_io": 0, 00:09:30.760 "completed_nvme_io": 141, 00:09:30.760 "transports": [ 00:09:30.760 { 00:09:30.760 "trtype": "RDMA", 00:09:30.760 "pending_data_buffer": 0, 00:09:30.760 "devices": [ 00:09:30.760 { 00:09:30.760 "name": "mlx5_0", 00:09:30.760 "polls": 3502774, 00:09:30.760 "idle_polls": 3502440, 00:09:30.760 "completions": 395, 00:09:30.760 "requests": 197, 00:09:30.760 "request_latency": 43498004, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 337, 00:09:30.760 "send_doorbell_updates": 161, 00:09:30.760 "total_recv_wrs": 4293, 00:09:30.760 "recv_doorbell_updates": 161 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "mlx5_1", 00:09:30.760 "polls": 3502774, 00:09:30.760 "idle_polls": 3502774, 00:09:30.760 "completions": 0, 00:09:30.760 "requests": 0, 00:09:30.760 "request_latency": 0, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 0, 00:09:30.760 "send_doorbell_updates": 0, 00:09:30.760 "total_recv_wrs": 4096, 00:09:30.760 "recv_doorbell_updates": 1 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "nvmf_tgt_poll_group_1", 00:09:30.760 "admin_qpairs": 2, 00:09:30.760 "io_qpairs": 26, 00:09:30.760 "current_admin_qpairs": 0, 00:09:30.760 "current_io_qpairs": 0, 00:09:30.760 "pending_bdev_io": 0, 00:09:30.760 "completed_nvme_io": 66, 00:09:30.760 "transports": [ 00:09:30.760 { 00:09:30.760 "trtype": "RDMA", 00:09:30.760 "pending_data_buffer": 0, 00:09:30.760 "devices": [ 00:09:30.760 { 00:09:30.760 "name": "mlx5_0", 00:09:30.760 "polls": 3432006, 00:09:30.760 "idle_polls": 3431767, 00:09:30.760 "completions": 244, 00:09:30.760 "requests": 122, 00:09:30.760 "request_latency": 13369776, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 188, 00:09:30.760 "send_doorbell_updates": 120, 00:09:30.760 "total_recv_wrs": 4218, 00:09:30.760 "recv_doorbell_updates": 121 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "mlx5_1", 00:09:30.760 "polls": 3432006, 00:09:30.760 "idle_polls": 3432006, 00:09:30.760 "completions": 0, 00:09:30.760 "requests": 0, 00:09:30.760 "request_latency": 0, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 0, 00:09:30.760 "send_doorbell_updates": 0, 00:09:30.760 "total_recv_wrs": 4096, 00:09:30.760 "recv_doorbell_updates": 1 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "nvmf_tgt_poll_group_2", 00:09:30.760 "admin_qpairs": 1, 00:09:30.760 "io_qpairs": 26, 00:09:30.760 "current_admin_qpairs": 0, 00:09:30.760 "current_io_qpairs": 0, 00:09:30.760 "pending_bdev_io": 0, 00:09:30.760 "completed_nvme_io": 102, 00:09:30.760 "transports": [ 00:09:30.760 { 00:09:30.760 "trtype": "RDMA", 00:09:30.760 "pending_data_buffer": 0, 00:09:30.760 "devices": [ 00:09:30.760 { 00:09:30.760 "name": "mlx5_0", 00:09:30.760 "polls": 3512073, 00:09:30.760 "idle_polls": 3511833, 00:09:30.760 "completions": 259, 00:09:30.760 "requests": 129, 00:09:30.760 "request_latency": 21358004, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 218, 00:09:30.760 "send_doorbell_updates": 120, 00:09:30.760 "total_recv_wrs": 4225, 00:09:30.760 "recv_doorbell_updates": 120 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "mlx5_1", 00:09:30.760 "polls": 3512073, 00:09:30.760 "idle_polls": 3512073, 00:09:30.760 "completions": 0, 00:09:30.760 "requests": 0, 00:09:30.760 "request_latency": 0, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 0, 00:09:30.760 "send_doorbell_updates": 0, 00:09:30.760 "total_recv_wrs": 4096, 00:09:30.760 "recv_doorbell_updates": 1 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "nvmf_tgt_poll_group_3", 00:09:30.760 "admin_qpairs": 2, 00:09:30.760 "io_qpairs": 26, 00:09:30.760 "current_admin_qpairs": 0, 00:09:30.760 "current_io_qpairs": 0, 00:09:30.760 "pending_bdev_io": 0, 00:09:30.760 "completed_nvme_io": 146, 00:09:30.760 "transports": [ 00:09:30.760 { 00:09:30.760 "trtype": "RDMA", 00:09:30.760 "pending_data_buffer": 0, 00:09:30.760 "devices": [ 00:09:30.760 { 00:09:30.760 "name": "mlx5_0", 00:09:30.760 "polls": 2753649, 00:09:30.760 "idle_polls": 2753309, 00:09:30.760 "completions": 402, 00:09:30.760 "requests": 201, 00:09:30.760 "request_latency": 44191712, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 346, 00:09:30.760 "send_doorbell_updates": 168, 00:09:30.760 "total_recv_wrs": 4297, 00:09:30.760 "recv_doorbell_updates": 169 00:09:30.760 }, 00:09:30.760 { 00:09:30.760 "name": "mlx5_1", 00:09:30.760 "polls": 2753649, 00:09:30.760 "idle_polls": 2753649, 00:09:30.760 "completions": 0, 00:09:30.760 "requests": 0, 00:09:30.760 "request_latency": 0, 00:09:30.760 "pending_free_request": 0, 00:09:30.760 "pending_rdma_read": 0, 00:09:30.760 "pending_rdma_write": 0, 00:09:30.760 "pending_rdma_send": 0, 00:09:30.760 "total_send_wrs": 0, 00:09:30.760 "send_doorbell_updates": 0, 00:09:30.760 "total_recv_wrs": 4096, 00:09:30.760 "recv_doorbell_updates": 1 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 } 00:09:30.760 ] 00:09:30.760 }' 00:09:30.760 17:57:39 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:30.760 17:57:39 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:09:30.760 17:57:39 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:30.760 17:57:39 -- target/rpc.sh@113 -- # (( 105 > 0 )) 00:09:30.760 17:57:39 -- target/rpc.sh@115 -- # '[' rdma == rdma ']' 00:09:30.760 17:57:39 -- target/rpc.sh@117 -- # jsum '.poll_groups[].transports[].devices[].completions' 00:09:30.760 17:57:39 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].completions' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].completions' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:30.760 17:57:39 -- target/rpc.sh@117 -- # (( 1300 > 0 )) 00:09:30.760 17:57:39 -- target/rpc.sh@118 -- # jsum '.poll_groups[].transports[].devices[].request_latency' 00:09:30.760 17:57:39 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].transports[].devices[].request_latency' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # jq '.poll_groups[].transports[].devices[].request_latency' 00:09:30.760 17:57:39 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:09:30.760 17:57:39 -- target/rpc.sh@118 -- # (( 122417496 > 0 )) 00:09:30.760 17:57:39 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:09:30.760 17:57:39 -- target/rpc.sh@123 -- # nvmftestfini 00:09:30.760 17:57:39 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:30.760 17:57:39 -- nvmf/common.sh@117 -- # sync 00:09:30.760 17:57:39 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:30.760 17:57:39 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:30.760 17:57:39 -- nvmf/common.sh@120 -- # set +e 00:09:30.760 17:57:39 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:30.760 17:57:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:30.760 rmmod nvme_rdma 00:09:30.760 rmmod nvme_fabrics 00:09:30.760 17:57:39 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:30.760 17:57:39 -- nvmf/common.sh@124 -- # set -e 00:09:30.760 17:57:39 -- nvmf/common.sh@125 -- # return 0 00:09:30.760 17:57:39 -- nvmf/common.sh@478 -- # '[' -n 877264 ']' 00:09:30.760 17:57:39 -- nvmf/common.sh@479 -- # killprocess 877264 00:09:30.760 17:57:39 -- common/autotest_common.sh@946 -- # '[' -z 877264 ']' 00:09:30.760 17:57:39 -- common/autotest_common.sh@950 -- # kill -0 877264 00:09:30.760 17:57:39 -- common/autotest_common.sh@951 -- # uname 00:09:30.760 17:57:39 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:09:30.760 17:57:39 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 877264 00:09:31.018 17:57:39 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:09:31.018 17:57:39 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:09:31.018 17:57:39 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 877264' 00:09:31.018 killing process with pid 877264 00:09:31.018 17:57:39 -- common/autotest_common.sh@965 -- # kill 877264 00:09:31.018 17:57:39 -- common/autotest_common.sh@970 -- # wait 877264 00:09:31.018 [2024-04-26 17:57:40.072862] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:31.276 17:57:40 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:31.276 17:57:40 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:31.276 00:09:31.276 real 0m37.207s 00:09:31.276 user 2m3.335s 00:09:31.276 sys 0m6.638s 00:09:31.276 17:57:40 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:09:31.276 17:57:40 -- common/autotest_common.sh@10 -- # set +x 00:09:31.276 ************************************ 00:09:31.276 END TEST nvmf_rpc 00:09:31.276 ************************************ 00:09:31.276 17:57:40 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:09:31.276 17:57:40 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:09:31.276 17:57:40 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:09:31.276 17:57:40 -- common/autotest_common.sh@10 -- # set +x 00:09:31.535 ************************************ 00:09:31.535 START TEST nvmf_invalid 00:09:31.535 ************************************ 00:09:31.535 17:57:40 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=rdma 00:09:31.535 * Looking for test storage... 00:09:31.535 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:31.535 17:57:40 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:31.535 17:57:40 -- nvmf/common.sh@7 -- # uname -s 00:09:31.535 17:57:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:31.535 17:57:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:31.535 17:57:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:31.535 17:57:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:31.535 17:57:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:31.535 17:57:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:31.535 17:57:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:31.535 17:57:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:31.535 17:57:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:31.535 17:57:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:31.535 17:57:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:31.535 17:57:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:31.535 17:57:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:31.535 17:57:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:31.535 17:57:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:31.535 17:57:40 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:31.535 17:57:40 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:31.535 17:57:40 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:31.535 17:57:40 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:31.535 17:57:40 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:31.535 17:57:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.535 17:57:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.535 17:57:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.535 17:57:40 -- paths/export.sh@5 -- # export PATH 00:09:31.536 17:57:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:31.536 17:57:40 -- nvmf/common.sh@47 -- # : 0 00:09:31.536 17:57:40 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:31.536 17:57:40 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:31.536 17:57:40 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:31.536 17:57:40 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:31.536 17:57:40 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:31.536 17:57:40 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:31.536 17:57:40 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:31.536 17:57:40 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:31.536 17:57:40 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:09:31.536 17:57:40 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:09:31.536 17:57:40 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:09:31.536 17:57:40 -- target/invalid.sh@14 -- # target=foobar 00:09:31.536 17:57:40 -- target/invalid.sh@16 -- # RANDOM=0 00:09:31.536 17:57:40 -- target/invalid.sh@34 -- # nvmftestinit 00:09:31.536 17:57:40 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:31.536 17:57:40 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:31.536 17:57:40 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:31.536 17:57:40 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:31.536 17:57:40 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:31.536 17:57:40 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:31.536 17:57:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:31.536 17:57:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:31.536 17:57:40 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:31.536 17:57:40 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:31.536 17:57:40 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:31.536 17:57:40 -- common/autotest_common.sh@10 -- # set +x 00:09:38.100 17:57:46 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:38.100 17:57:46 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:38.100 17:57:46 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:38.100 17:57:46 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:38.100 17:57:46 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:38.100 17:57:46 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:38.100 17:57:46 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:38.100 17:57:46 -- nvmf/common.sh@295 -- # net_devs=() 00:09:38.100 17:57:46 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:38.100 17:57:46 -- nvmf/common.sh@296 -- # e810=() 00:09:38.100 17:57:46 -- nvmf/common.sh@296 -- # local -ga e810 00:09:38.100 17:57:46 -- nvmf/common.sh@297 -- # x722=() 00:09:38.100 17:57:46 -- nvmf/common.sh@297 -- # local -ga x722 00:09:38.100 17:57:46 -- nvmf/common.sh@298 -- # mlx=() 00:09:38.100 17:57:46 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:38.100 17:57:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:38.100 17:57:46 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:38.100 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:38.100 17:57:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.100 17:57:46 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:38.100 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:38.100 17:57:46 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:38.100 17:57:46 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.100 17:57:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.100 17:57:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:38.100 Found net devices under 0000:18:00.0: mlx_0_0 00:09:38.100 17:57:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:38.100 17:57:46 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:38.100 17:57:46 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:38.100 Found net devices under 0000:18:00.1: mlx_0_1 00:09:38.100 17:57:46 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:38.100 17:57:46 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:38.100 17:57:46 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:38.100 17:57:46 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:38.100 17:57:46 -- nvmf/common.sh@58 -- # uname 00:09:38.100 17:57:46 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:38.100 17:57:46 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:38.100 17:57:46 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:38.100 17:57:46 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:38.100 17:57:46 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:38.100 17:57:46 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:38.100 17:57:46 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:38.100 17:57:46 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:38.100 17:57:46 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:38.100 17:57:46 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:38.100 17:57:46 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:38.100 17:57:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:38.100 17:57:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:38.100 17:57:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:38.100 17:57:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:38.100 17:57:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:38.100 17:57:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:38.100 17:57:46 -- nvmf/common.sh@105 -- # continue 2 00:09:38.100 17:57:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.100 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:38.100 17:57:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:38.100 17:57:46 -- nvmf/common.sh@105 -- # continue 2 00:09:38.100 17:57:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:38.100 17:57:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:38.100 17:57:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:38.100 17:57:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:38.100 17:57:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.101 17:57:46 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:38.101 17:57:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:38.101 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:38.101 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:38.101 altname enp24s0f0np0 00:09:38.101 altname ens785f0np0 00:09:38.101 inet 192.168.100.8/24 scope global mlx_0_0 00:09:38.101 valid_lft forever preferred_lft forever 00:09:38.101 17:57:46 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:38.101 17:57:46 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.101 17:57:46 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:38.101 17:57:46 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:38.101 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:38.101 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:38.101 altname enp24s0f1np1 00:09:38.101 altname ens785f1np1 00:09:38.101 inet 192.168.100.9/24 scope global mlx_0_1 00:09:38.101 valid_lft forever preferred_lft forever 00:09:38.101 17:57:46 -- nvmf/common.sh@411 -- # return 0 00:09:38.101 17:57:46 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:38.101 17:57:46 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:38.101 17:57:46 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:38.101 17:57:46 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:38.101 17:57:46 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:38.101 17:57:46 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:38.101 17:57:46 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:38.101 17:57:46 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:38.101 17:57:46 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:38.101 17:57:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.101 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.101 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:38.101 17:57:46 -- nvmf/common.sh@105 -- # continue 2 00:09:38.101 17:57:46 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:38.101 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.101 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:38.101 17:57:46 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:38.101 17:57:46 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@105 -- # continue 2 00:09:38.101 17:57:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:38.101 17:57:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:38.101 17:57:46 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.101 17:57:46 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:38.101 17:57:46 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:38.101 17:57:46 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:38.101 17:57:46 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:38.101 192.168.100.9' 00:09:38.101 17:57:46 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:38.101 192.168.100.9' 00:09:38.101 17:57:46 -- nvmf/common.sh@446 -- # head -n 1 00:09:38.101 17:57:46 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:38.101 17:57:46 -- nvmf/common.sh@447 -- # head -n 1 00:09:38.101 17:57:46 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:38.101 192.168.100.9' 00:09:38.101 17:57:46 -- nvmf/common.sh@447 -- # tail -n +2 00:09:38.101 17:57:46 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:38.101 17:57:46 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:38.101 17:57:46 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:38.101 17:57:46 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:38.101 17:57:46 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:38.101 17:57:46 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:38.101 17:57:46 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:09:38.101 17:57:46 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:38.101 17:57:46 -- common/autotest_common.sh@720 -- # xtrace_disable 00:09:38.101 17:57:46 -- common/autotest_common.sh@10 -- # set +x 00:09:38.101 17:57:46 -- nvmf/common.sh@470 -- # nvmfpid=884372 00:09:38.101 17:57:46 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:38.101 17:57:46 -- nvmf/common.sh@471 -- # waitforlisten 884372 00:09:38.101 17:57:46 -- common/autotest_common.sh@827 -- # '[' -z 884372 ']' 00:09:38.101 17:57:46 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:38.101 17:57:46 -- common/autotest_common.sh@832 -- # local max_retries=100 00:09:38.101 17:57:46 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:38.101 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:38.101 17:57:46 -- common/autotest_common.sh@836 -- # xtrace_disable 00:09:38.101 17:57:46 -- common/autotest_common.sh@10 -- # set +x 00:09:38.101 [2024-04-26 17:57:46.657613] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:09:38.101 [2024-04-26 17:57:46.657666] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:38.101 EAL: No free 2048 kB hugepages reported on node 1 00:09:38.101 [2024-04-26 17:57:46.720167] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:38.101 [2024-04-26 17:57:46.798562] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:38.101 [2024-04-26 17:57:46.798606] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:38.101 [2024-04-26 17:57:46.798615] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:38.101 [2024-04-26 17:57:46.798623] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:38.101 [2024-04-26 17:57:46.798630] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:38.101 [2024-04-26 17:57:46.798718] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:38.101 [2024-04-26 17:57:46.798804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:38.101 [2024-04-26 17:57:46.798881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:38.101 [2024-04-26 17:57:46.798882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:38.359 17:57:47 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:09:38.359 17:57:47 -- common/autotest_common.sh@860 -- # return 0 00:09:38.359 17:57:47 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:38.359 17:57:47 -- common/autotest_common.sh@726 -- # xtrace_disable 00:09:38.359 17:57:47 -- common/autotest_common.sh@10 -- # set +x 00:09:38.359 17:57:47 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:38.359 17:57:47 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:09:38.359 17:57:47 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode6661 00:09:38.618 [2024-04-26 17:57:47.698768] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:09:38.618 17:57:47 -- target/invalid.sh@40 -- # out='request: 00:09:38.618 { 00:09:38.618 "nqn": "nqn.2016-06.io.spdk:cnode6661", 00:09:38.618 "tgt_name": "foobar", 00:09:38.618 "method": "nvmf_create_subsystem", 00:09:38.618 "req_id": 1 00:09:38.618 } 00:09:38.618 Got JSON-RPC error response 00:09:38.618 response: 00:09:38.618 { 00:09:38.618 "code": -32603, 00:09:38.618 "message": "Unable to find target foobar" 00:09:38.618 }' 00:09:38.618 17:57:47 -- target/invalid.sh@41 -- # [[ request: 00:09:38.618 { 00:09:38.618 "nqn": "nqn.2016-06.io.spdk:cnode6661", 00:09:38.618 "tgt_name": "foobar", 00:09:38.618 "method": "nvmf_create_subsystem", 00:09:38.618 "req_id": 1 00:09:38.618 } 00:09:38.618 Got JSON-RPC error response 00:09:38.618 response: 00:09:38.618 { 00:09:38.618 "code": -32603, 00:09:38.618 "message": "Unable to find target foobar" 00:09:38.618 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:09:38.618 17:57:47 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:09:38.618 17:57:47 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode17948 00:09:38.876 [2024-04-26 17:57:47.907511] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17948: invalid serial number 'SPDKISFASTANDAWESOME' 00:09:38.876 17:57:47 -- target/invalid.sh@45 -- # out='request: 00:09:38.876 { 00:09:38.876 "nqn": "nqn.2016-06.io.spdk:cnode17948", 00:09:38.876 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:09:38.876 "method": "nvmf_create_subsystem", 00:09:38.876 "req_id": 1 00:09:38.876 } 00:09:38.876 Got JSON-RPC error response 00:09:38.876 response: 00:09:38.876 { 00:09:38.876 "code": -32602, 00:09:38.876 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:09:38.876 }' 00:09:38.876 17:57:47 -- target/invalid.sh@46 -- # [[ request: 00:09:38.876 { 00:09:38.876 "nqn": "nqn.2016-06.io.spdk:cnode17948", 00:09:38.876 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:09:38.876 "method": "nvmf_create_subsystem", 00:09:38.876 "req_id": 1 00:09:38.876 } 00:09:38.876 Got JSON-RPC error response 00:09:38.876 response: 00:09:38.876 { 00:09:38.876 "code": -32602, 00:09:38.876 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:09:38.876 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:09:38.876 17:57:47 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:09:38.876 17:57:47 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode17704 00:09:39.137 [2024-04-26 17:57:48.100075] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17704: invalid model number 'SPDK_Controller' 00:09:39.137 17:57:48 -- target/invalid.sh@50 -- # out='request: 00:09:39.137 { 00:09:39.137 "nqn": "nqn.2016-06.io.spdk:cnode17704", 00:09:39.137 "model_number": "SPDK_Controller\u001f", 00:09:39.137 "method": "nvmf_create_subsystem", 00:09:39.137 "req_id": 1 00:09:39.137 } 00:09:39.137 Got JSON-RPC error response 00:09:39.137 response: 00:09:39.137 { 00:09:39.137 "code": -32602, 00:09:39.137 "message": "Invalid MN SPDK_Controller\u001f" 00:09:39.137 }' 00:09:39.137 17:57:48 -- target/invalid.sh@51 -- # [[ request: 00:09:39.137 { 00:09:39.137 "nqn": "nqn.2016-06.io.spdk:cnode17704", 00:09:39.137 "model_number": "SPDK_Controller\u001f", 00:09:39.137 "method": "nvmf_create_subsystem", 00:09:39.137 "req_id": 1 00:09:39.137 } 00:09:39.137 Got JSON-RPC error response 00:09:39.137 response: 00:09:39.137 { 00:09:39.137 "code": -32602, 00:09:39.137 "message": "Invalid MN SPDK_Controller\u001f" 00:09:39.137 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:09:39.137 17:57:48 -- target/invalid.sh@54 -- # gen_random_s 21 00:09:39.137 17:57:48 -- target/invalid.sh@19 -- # local length=21 ll 00:09:39.137 17:57:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:09:39.137 17:57:48 -- target/invalid.sh@21 -- # local chars 00:09:39.137 17:57:48 -- target/invalid.sh@22 -- # local string 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 105 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x69' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=i 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 45 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=- 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 113 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x71' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=q 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 53 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x35' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=5 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 57 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x39' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=9 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 93 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=']' 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 39 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x27' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=\' 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 109 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=m 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 105 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x69' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=i 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 77 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=M 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 52 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x34' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=4 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 34 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x22' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+='"' 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 55 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x37' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=7 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 65 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x41' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=A 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 110 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=n 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 118 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=v 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 97 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x61' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=a 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 39 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x27' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=\' 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 93 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=']' 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 90 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=Z 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # printf %x 112 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x70' 00:09:39.137 17:57:48 -- target/invalid.sh@25 -- # string+=p 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.137 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.137 17:57:48 -- target/invalid.sh@28 -- # [[ i == \- ]] 00:09:39.137 17:57:48 -- target/invalid.sh@31 -- # echo 'i-q59]'\''miM4"7Anva'\'']Zp' 00:09:39.137 17:57:48 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'i-q59]'\''miM4"7Anva'\'']Zp' nqn.2016-06.io.spdk:cnode864 00:09:39.397 [2024-04-26 17:57:48.453247] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode864: invalid serial number 'i-q59]'miM4"7Anva']Zp' 00:09:39.397 17:57:48 -- target/invalid.sh@54 -- # out='request: 00:09:39.397 { 00:09:39.397 "nqn": "nqn.2016-06.io.spdk:cnode864", 00:09:39.397 "serial_number": "i-q59]'\''miM4\"7Anva'\'']Zp", 00:09:39.397 "method": "nvmf_create_subsystem", 00:09:39.397 "req_id": 1 00:09:39.397 } 00:09:39.397 Got JSON-RPC error response 00:09:39.397 response: 00:09:39.397 { 00:09:39.397 "code": -32602, 00:09:39.397 "message": "Invalid SN i-q59]'\''miM4\"7Anva'\'']Zp" 00:09:39.397 }' 00:09:39.397 17:57:48 -- target/invalid.sh@55 -- # [[ request: 00:09:39.397 { 00:09:39.397 "nqn": "nqn.2016-06.io.spdk:cnode864", 00:09:39.397 "serial_number": "i-q59]'miM4\"7Anva']Zp", 00:09:39.397 "method": "nvmf_create_subsystem", 00:09:39.397 "req_id": 1 00:09:39.397 } 00:09:39.397 Got JSON-RPC error response 00:09:39.397 response: 00:09:39.397 { 00:09:39.397 "code": -32602, 00:09:39.397 "message": "Invalid SN i-q59]'miM4\"7Anva']Zp" 00:09:39.397 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:09:39.397 17:57:48 -- target/invalid.sh@58 -- # gen_random_s 41 00:09:39.397 17:57:48 -- target/invalid.sh@19 -- # local length=41 ll 00:09:39.397 17:57:48 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:09:39.397 17:57:48 -- target/invalid.sh@21 -- # local chars 00:09:39.397 17:57:48 -- target/invalid.sh@22 -- # local string 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 90 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=Z 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 106 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=j 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 76 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=L 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 88 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x58' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=X 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 50 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x32' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=2 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 102 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x66' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=f 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 110 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=n 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 105 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x69' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=i 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 88 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x58' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+=X 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # printf %x 125 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:09:39.397 17:57:48 -- target/invalid.sh@25 -- # string+='}' 00:09:39.397 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # printf %x 96 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x60' 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # string+='`' 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # printf %x 113 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x71' 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # string+=q 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # printf %x 95 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # string+=_ 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # printf %x 42 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:09:39.398 17:57:48 -- target/invalid.sh@25 -- # string+='*' 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.398 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 71 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x47' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=G 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 101 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x65' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=e 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 89 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x59' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=Y 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 79 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=O 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 83 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x53' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=S 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 108 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=l 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 96 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x60' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+='`' 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 91 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5b' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+='[' 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 89 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x59' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=Y 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 124 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+='|' 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 83 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x53' 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # string+=S 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.657 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.657 17:57:48 -- target/invalid.sh@25 -- # printf %x 54 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x36' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=6 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 43 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x2b' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=+ 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 80 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=P 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 78 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=N 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 118 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x76' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=v 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 92 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x5c' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+='\' 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 80 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x50' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=P 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 116 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x74' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=t 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 85 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x55' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=U 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 89 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x59' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=Y 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 123 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+='{' 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 63 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+='?' 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 122 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=z 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 49 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x31' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=1 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 57 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x39' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=9 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # printf %x 76 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:09:39.658 17:57:48 -- target/invalid.sh@25 -- # string+=L 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll++ )) 00:09:39.658 17:57:48 -- target/invalid.sh@24 -- # (( ll < length )) 00:09:39.658 17:57:48 -- target/invalid.sh@28 -- # [[ Z == \- ]] 00:09:39.658 17:57:48 -- target/invalid.sh@31 -- # echo 'ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\PtUY{?z19L' 00:09:39.658 17:57:48 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\PtUY{?z19L' nqn.2016-06.io.spdk:cnode31518 00:09:39.917 [2024-04-26 17:57:48.958978] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31518: invalid model number 'ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\PtUY{?z19L' 00:09:39.917 17:57:48 -- target/invalid.sh@58 -- # out='request: 00:09:39.917 { 00:09:39.917 "nqn": "nqn.2016-06.io.spdk:cnode31518", 00:09:39.917 "model_number": "ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\\PtUY{?z19L", 00:09:39.917 "method": "nvmf_create_subsystem", 00:09:39.917 "req_id": 1 00:09:39.917 } 00:09:39.917 Got JSON-RPC error response 00:09:39.917 response: 00:09:39.917 { 00:09:39.917 "code": -32602, 00:09:39.917 "message": "Invalid MN ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\\PtUY{?z19L" 00:09:39.917 }' 00:09:39.917 17:57:48 -- target/invalid.sh@59 -- # [[ request: 00:09:39.917 { 00:09:39.917 "nqn": "nqn.2016-06.io.spdk:cnode31518", 00:09:39.917 "model_number": "ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\\PtUY{?z19L", 00:09:39.917 "method": "nvmf_create_subsystem", 00:09:39.917 "req_id": 1 00:09:39.917 } 00:09:39.917 Got JSON-RPC error response 00:09:39.917 response: 00:09:39.917 { 00:09:39.917 "code": -32602, 00:09:39.917 "message": "Invalid MN ZjLX2fniX}`q_*GeYOSl`[Y|S6+PNv\\PtUY{?z19L" 00:09:39.917 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:09:39.917 17:57:48 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype rdma 00:09:40.176 [2024-04-26 17:57:49.181684] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x16b2bb0/0x16b70a0) succeed. 00:09:40.176 [2024-04-26 17:57:49.192184] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x16b41f0/0x16f8730) succeed. 00:09:40.176 17:57:49 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:09:40.435 17:57:49 -- target/invalid.sh@64 -- # [[ rdma == \T\C\P ]] 00:09:40.435 17:57:49 -- target/invalid.sh@67 -- # echo '192.168.100.8 00:09:40.435 192.168.100.9' 00:09:40.435 17:57:49 -- target/invalid.sh@67 -- # head -n 1 00:09:40.435 17:57:49 -- target/invalid.sh@67 -- # IP=192.168.100.8 00:09:40.435 17:57:49 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t rdma -a 192.168.100.8 -s 4421 00:09:40.694 [2024-04-26 17:57:49.693121] nvmf_rpc.c: 792:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:09:40.694 17:57:49 -- target/invalid.sh@69 -- # out='request: 00:09:40.694 { 00:09:40.694 "nqn": "nqn.2016-06.io.spdk:cnode", 00:09:40.694 "listen_address": { 00:09:40.694 "trtype": "rdma", 00:09:40.694 "traddr": "192.168.100.8", 00:09:40.694 "trsvcid": "4421" 00:09:40.694 }, 00:09:40.694 "method": "nvmf_subsystem_remove_listener", 00:09:40.694 "req_id": 1 00:09:40.694 } 00:09:40.694 Got JSON-RPC error response 00:09:40.694 response: 00:09:40.694 { 00:09:40.694 "code": -32602, 00:09:40.694 "message": "Invalid parameters" 00:09:40.694 }' 00:09:40.694 17:57:49 -- target/invalid.sh@70 -- # [[ request: 00:09:40.694 { 00:09:40.694 "nqn": "nqn.2016-06.io.spdk:cnode", 00:09:40.694 "listen_address": { 00:09:40.694 "trtype": "rdma", 00:09:40.694 "traddr": "192.168.100.8", 00:09:40.694 "trsvcid": "4421" 00:09:40.694 }, 00:09:40.694 "method": "nvmf_subsystem_remove_listener", 00:09:40.694 "req_id": 1 00:09:40.694 } 00:09:40.694 Got JSON-RPC error response 00:09:40.694 response: 00:09:40.694 { 00:09:40.694 "code": -32602, 00:09:40.694 "message": "Invalid parameters" 00:09:40.694 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:09:40.694 17:57:49 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4177 -i 0 00:09:40.694 [2024-04-26 17:57:49.865731] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4177: invalid cntlid range [0-65519] 00:09:40.953 17:57:49 -- target/invalid.sh@73 -- # out='request: 00:09:40.953 { 00:09:40.953 "nqn": "nqn.2016-06.io.spdk:cnode4177", 00:09:40.953 "min_cntlid": 0, 00:09:40.953 "method": "nvmf_create_subsystem", 00:09:40.953 "req_id": 1 00:09:40.953 } 00:09:40.953 Got JSON-RPC error response 00:09:40.953 response: 00:09:40.953 { 00:09:40.953 "code": -32602, 00:09:40.953 "message": "Invalid cntlid range [0-65519]" 00:09:40.953 }' 00:09:40.953 17:57:49 -- target/invalid.sh@74 -- # [[ request: 00:09:40.953 { 00:09:40.953 "nqn": "nqn.2016-06.io.spdk:cnode4177", 00:09:40.953 "min_cntlid": 0, 00:09:40.953 "method": "nvmf_create_subsystem", 00:09:40.953 "req_id": 1 00:09:40.953 } 00:09:40.953 Got JSON-RPC error response 00:09:40.953 response: 00:09:40.953 { 00:09:40.953 "code": -32602, 00:09:40.953 "message": "Invalid cntlid range [0-65519]" 00:09:40.953 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:40.953 17:57:49 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23051 -i 65520 00:09:40.953 [2024-04-26 17:57:50.058412] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23051: invalid cntlid range [65520-65519] 00:09:40.953 17:57:50 -- target/invalid.sh@75 -- # out='request: 00:09:40.953 { 00:09:40.953 "nqn": "nqn.2016-06.io.spdk:cnode23051", 00:09:40.953 "min_cntlid": 65520, 00:09:40.953 "method": "nvmf_create_subsystem", 00:09:40.953 "req_id": 1 00:09:40.953 } 00:09:40.953 Got JSON-RPC error response 00:09:40.953 response: 00:09:40.953 { 00:09:40.953 "code": -32602, 00:09:40.953 "message": "Invalid cntlid range [65520-65519]" 00:09:40.953 }' 00:09:40.953 17:57:50 -- target/invalid.sh@76 -- # [[ request: 00:09:40.953 { 00:09:40.953 "nqn": "nqn.2016-06.io.spdk:cnode23051", 00:09:40.953 "min_cntlid": 65520, 00:09:40.953 "method": "nvmf_create_subsystem", 00:09:40.953 "req_id": 1 00:09:40.953 } 00:09:40.953 Got JSON-RPC error response 00:09:40.953 response: 00:09:40.953 { 00:09:40.953 "code": -32602, 00:09:40.953 "message": "Invalid cntlid range [65520-65519]" 00:09:40.953 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:40.953 17:57:50 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode20581 -I 0 00:09:41.212 [2024-04-26 17:57:50.251101] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20581: invalid cntlid range [1-0] 00:09:41.212 17:57:50 -- target/invalid.sh@77 -- # out='request: 00:09:41.212 { 00:09:41.212 "nqn": "nqn.2016-06.io.spdk:cnode20581", 00:09:41.212 "max_cntlid": 0, 00:09:41.212 "method": "nvmf_create_subsystem", 00:09:41.212 "req_id": 1 00:09:41.212 } 00:09:41.212 Got JSON-RPC error response 00:09:41.212 response: 00:09:41.212 { 00:09:41.212 "code": -32602, 00:09:41.212 "message": "Invalid cntlid range [1-0]" 00:09:41.212 }' 00:09:41.212 17:57:50 -- target/invalid.sh@78 -- # [[ request: 00:09:41.212 { 00:09:41.212 "nqn": "nqn.2016-06.io.spdk:cnode20581", 00:09:41.212 "max_cntlid": 0, 00:09:41.212 "method": "nvmf_create_subsystem", 00:09:41.212 "req_id": 1 00:09:41.212 } 00:09:41.212 Got JSON-RPC error response 00:09:41.212 response: 00:09:41.212 { 00:09:41.212 "code": -32602, 00:09:41.212 "message": "Invalid cntlid range [1-0]" 00:09:41.212 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:41.212 17:57:50 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31752 -I 65520 00:09:41.470 [2024-04-26 17:57:50.443796] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31752: invalid cntlid range [1-65520] 00:09:41.470 17:57:50 -- target/invalid.sh@79 -- # out='request: 00:09:41.470 { 00:09:41.470 "nqn": "nqn.2016-06.io.spdk:cnode31752", 00:09:41.470 "max_cntlid": 65520, 00:09:41.470 "method": "nvmf_create_subsystem", 00:09:41.470 "req_id": 1 00:09:41.470 } 00:09:41.470 Got JSON-RPC error response 00:09:41.470 response: 00:09:41.470 { 00:09:41.470 "code": -32602, 00:09:41.470 "message": "Invalid cntlid range [1-65520]" 00:09:41.470 }' 00:09:41.470 17:57:50 -- target/invalid.sh@80 -- # [[ request: 00:09:41.470 { 00:09:41.470 "nqn": "nqn.2016-06.io.spdk:cnode31752", 00:09:41.470 "max_cntlid": 65520, 00:09:41.470 "method": "nvmf_create_subsystem", 00:09:41.470 "req_id": 1 00:09:41.470 } 00:09:41.470 Got JSON-RPC error response 00:09:41.470 response: 00:09:41.470 { 00:09:41.470 "code": -32602, 00:09:41.470 "message": "Invalid cntlid range [1-65520]" 00:09:41.470 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:41.470 17:57:50 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode20726 -i 6 -I 5 00:09:41.470 [2024-04-26 17:57:50.652590] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20726: invalid cntlid range [6-5] 00:09:41.729 17:57:50 -- target/invalid.sh@83 -- # out='request: 00:09:41.729 { 00:09:41.729 "nqn": "nqn.2016-06.io.spdk:cnode20726", 00:09:41.729 "min_cntlid": 6, 00:09:41.729 "max_cntlid": 5, 00:09:41.729 "method": "nvmf_create_subsystem", 00:09:41.729 "req_id": 1 00:09:41.729 } 00:09:41.729 Got JSON-RPC error response 00:09:41.729 response: 00:09:41.729 { 00:09:41.729 "code": -32602, 00:09:41.729 "message": "Invalid cntlid range [6-5]" 00:09:41.730 }' 00:09:41.730 17:57:50 -- target/invalid.sh@84 -- # [[ request: 00:09:41.730 { 00:09:41.730 "nqn": "nqn.2016-06.io.spdk:cnode20726", 00:09:41.730 "min_cntlid": 6, 00:09:41.730 "max_cntlid": 5, 00:09:41.730 "method": "nvmf_create_subsystem", 00:09:41.730 "req_id": 1 00:09:41.730 } 00:09:41.730 Got JSON-RPC error response 00:09:41.730 response: 00:09:41.730 { 00:09:41.730 "code": -32602, 00:09:41.730 "message": "Invalid cntlid range [6-5]" 00:09:41.730 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:09:41.730 17:57:50 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:09:41.730 17:57:50 -- target/invalid.sh@87 -- # out='request: 00:09:41.730 { 00:09:41.730 "name": "foobar", 00:09:41.730 "method": "nvmf_delete_target", 00:09:41.730 "req_id": 1 00:09:41.730 } 00:09:41.730 Got JSON-RPC error response 00:09:41.730 response: 00:09:41.730 { 00:09:41.730 "code": -32602, 00:09:41.730 "message": "The specified target doesn'\''t exist, cannot delete it." 00:09:41.730 }' 00:09:41.730 17:57:50 -- target/invalid.sh@88 -- # [[ request: 00:09:41.730 { 00:09:41.730 "name": "foobar", 00:09:41.730 "method": "nvmf_delete_target", 00:09:41.730 "req_id": 1 00:09:41.730 } 00:09:41.730 Got JSON-RPC error response 00:09:41.730 response: 00:09:41.730 { 00:09:41.730 "code": -32602, 00:09:41.730 "message": "The specified target doesn't exist, cannot delete it." 00:09:41.730 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:09:41.730 17:57:50 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:09:41.730 17:57:50 -- target/invalid.sh@91 -- # nvmftestfini 00:09:41.730 17:57:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:41.730 17:57:50 -- nvmf/common.sh@117 -- # sync 00:09:41.730 17:57:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:41.730 17:57:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:41.730 17:57:50 -- nvmf/common.sh@120 -- # set +e 00:09:41.730 17:57:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:41.730 17:57:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:41.730 rmmod nvme_rdma 00:09:41.730 rmmod nvme_fabrics 00:09:41.730 17:57:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:41.730 17:57:50 -- nvmf/common.sh@124 -- # set -e 00:09:41.730 17:57:50 -- nvmf/common.sh@125 -- # return 0 00:09:41.730 17:57:50 -- nvmf/common.sh@478 -- # '[' -n 884372 ']' 00:09:41.730 17:57:50 -- nvmf/common.sh@479 -- # killprocess 884372 00:09:41.730 17:57:50 -- common/autotest_common.sh@946 -- # '[' -z 884372 ']' 00:09:41.730 17:57:50 -- common/autotest_common.sh@950 -- # kill -0 884372 00:09:41.730 17:57:50 -- common/autotest_common.sh@951 -- # uname 00:09:41.730 17:57:50 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:09:41.730 17:57:50 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 884372 00:09:41.730 17:57:50 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:09:41.730 17:57:50 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:09:41.730 17:57:50 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 884372' 00:09:41.730 killing process with pid 884372 00:09:41.730 17:57:50 -- common/autotest_common.sh@965 -- # kill 884372 00:09:41.730 17:57:50 -- common/autotest_common.sh@970 -- # wait 884372 00:09:41.989 [2024-04-26 17:57:50.965972] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:42.250 17:57:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:42.250 17:57:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:42.250 00:09:42.250 real 0m10.643s 00:09:42.250 user 0m21.280s 00:09:42.250 sys 0m5.730s 00:09:42.250 17:57:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:09:42.250 17:57:51 -- common/autotest_common.sh@10 -- # set +x 00:09:42.250 ************************************ 00:09:42.250 END TEST nvmf_invalid 00:09:42.250 ************************************ 00:09:42.250 17:57:51 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:09:42.250 17:57:51 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:09:42.250 17:57:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:09:42.250 17:57:51 -- common/autotest_common.sh@10 -- # set +x 00:09:42.250 ************************************ 00:09:42.250 START TEST nvmf_abort 00:09:42.250 ************************************ 00:09:42.250 17:57:51 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=rdma 00:09:42.574 * Looking for test storage... 00:09:42.574 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:42.574 17:57:51 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:42.574 17:57:51 -- nvmf/common.sh@7 -- # uname -s 00:09:42.574 17:57:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:42.574 17:57:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:42.574 17:57:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:42.574 17:57:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:42.574 17:57:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:42.574 17:57:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:42.574 17:57:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:42.574 17:57:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:42.574 17:57:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:42.574 17:57:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:42.574 17:57:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:42.574 17:57:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:42.574 17:57:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:42.574 17:57:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:42.574 17:57:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:42.574 17:57:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:42.574 17:57:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:42.574 17:57:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:42.574 17:57:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:42.574 17:57:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:42.574 17:57:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.574 17:57:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.574 17:57:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.574 17:57:51 -- paths/export.sh@5 -- # export PATH 00:09:42.574 17:57:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:42.574 17:57:51 -- nvmf/common.sh@47 -- # : 0 00:09:42.574 17:57:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:42.574 17:57:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:42.574 17:57:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:42.574 17:57:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:42.574 17:57:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:42.574 17:57:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:42.574 17:57:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:42.574 17:57:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:42.574 17:57:51 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:42.574 17:57:51 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:09:42.574 17:57:51 -- target/abort.sh@14 -- # nvmftestinit 00:09:42.574 17:57:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:42.574 17:57:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:42.574 17:57:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:42.574 17:57:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:42.574 17:57:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:42.574 17:57:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:42.574 17:57:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:42.574 17:57:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:42.574 17:57:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:42.574 17:57:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:42.574 17:57:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:42.574 17:57:51 -- common/autotest_common.sh@10 -- # set +x 00:09:49.140 17:57:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:49.140 17:57:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:49.140 17:57:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:49.140 17:57:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:49.140 17:57:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:49.140 17:57:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:49.140 17:57:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:49.140 17:57:57 -- nvmf/common.sh@295 -- # net_devs=() 00:09:49.140 17:57:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:49.140 17:57:57 -- nvmf/common.sh@296 -- # e810=() 00:09:49.140 17:57:57 -- nvmf/common.sh@296 -- # local -ga e810 00:09:49.140 17:57:57 -- nvmf/common.sh@297 -- # x722=() 00:09:49.140 17:57:57 -- nvmf/common.sh@297 -- # local -ga x722 00:09:49.140 17:57:57 -- nvmf/common.sh@298 -- # mlx=() 00:09:49.140 17:57:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:49.140 17:57:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:49.140 17:57:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:49.140 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:49.140 17:57:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:49.140 17:57:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:49.140 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:49.140 17:57:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:49.140 17:57:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:49.140 17:57:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:49.140 17:57:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:49.140 Found net devices under 0000:18:00.0: mlx_0_0 00:09:49.140 17:57:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:49.140 17:57:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:49.140 17:57:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:49.140 Found net devices under 0000:18:00.1: mlx_0_1 00:09:49.140 17:57:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:49.140 17:57:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:49.140 17:57:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:49.140 17:57:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:49.140 17:57:57 -- nvmf/common.sh@58 -- # uname 00:09:49.140 17:57:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:49.140 17:57:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:49.140 17:57:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:49.140 17:57:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:49.140 17:57:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:49.140 17:57:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:49.140 17:57:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:49.140 17:57:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:49.140 17:57:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:49.140 17:57:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:49.140 17:57:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:49.140 17:57:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:49.140 17:57:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:49.140 17:57:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:49.140 17:57:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:49.140 17:57:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:49.140 17:57:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:49.140 17:57:57 -- nvmf/common.sh@105 -- # continue 2 00:09:49.140 17:57:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.140 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:49.140 17:57:57 -- nvmf/common.sh@105 -- # continue 2 00:09:49.140 17:57:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:49.140 17:57:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:49.140 17:57:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:49.140 17:57:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:49.140 17:57:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:49.140 17:57:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:49.140 17:57:57 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:49.140 17:57:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:49.140 17:57:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:49.140 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:49.140 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:49.141 altname enp24s0f0np0 00:09:49.141 altname ens785f0np0 00:09:49.141 inet 192.168.100.8/24 scope global mlx_0_0 00:09:49.141 valid_lft forever preferred_lft forever 00:09:49.141 17:57:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:49.141 17:57:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:49.141 17:57:57 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:49.141 17:57:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:49.141 17:57:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:49.141 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:49.141 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:49.141 altname enp24s0f1np1 00:09:49.141 altname ens785f1np1 00:09:49.141 inet 192.168.100.9/24 scope global mlx_0_1 00:09:49.141 valid_lft forever preferred_lft forever 00:09:49.141 17:57:57 -- nvmf/common.sh@411 -- # return 0 00:09:49.141 17:57:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:49.141 17:57:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:49.141 17:57:57 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:49.141 17:57:57 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:49.141 17:57:57 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:49.141 17:57:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:49.141 17:57:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:49.141 17:57:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:49.141 17:57:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:49.141 17:57:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:49.141 17:57:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:49.141 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.141 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:49.141 17:57:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:49.141 17:57:57 -- nvmf/common.sh@105 -- # continue 2 00:09:49.141 17:57:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:49.141 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.141 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:49.141 17:57:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:49.141 17:57:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:49.141 17:57:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@105 -- # continue 2 00:09:49.141 17:57:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:49.141 17:57:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:49.141 17:57:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:49.141 17:57:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:49.141 17:57:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:49.141 17:57:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:49.141 17:57:57 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:49.141 192.168.100.9' 00:09:49.141 17:57:57 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:49.141 192.168.100.9' 00:09:49.141 17:57:57 -- nvmf/common.sh@446 -- # head -n 1 00:09:49.141 17:57:57 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:49.141 17:57:57 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:49.141 192.168.100.9' 00:09:49.141 17:57:57 -- nvmf/common.sh@447 -- # tail -n +2 00:09:49.141 17:57:57 -- nvmf/common.sh@447 -- # head -n 1 00:09:49.141 17:57:57 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:49.141 17:57:57 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:49.141 17:57:57 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:49.141 17:57:57 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:49.141 17:57:57 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:49.141 17:57:57 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:49.141 17:57:57 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:09:49.141 17:57:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:49.141 17:57:57 -- common/autotest_common.sh@720 -- # xtrace_disable 00:09:49.141 17:57:57 -- common/autotest_common.sh@10 -- # set +x 00:09:49.141 17:57:57 -- nvmf/common.sh@470 -- # nvmfpid=888002 00:09:49.141 17:57:57 -- nvmf/common.sh@471 -- # waitforlisten 888002 00:09:49.141 17:57:57 -- common/autotest_common.sh@827 -- # '[' -z 888002 ']' 00:09:49.141 17:57:57 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:49.141 17:57:57 -- common/autotest_common.sh@832 -- # local max_retries=100 00:09:49.141 17:57:57 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:49.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:49.141 17:57:57 -- common/autotest_common.sh@836 -- # xtrace_disable 00:09:49.141 17:57:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:49.141 17:57:57 -- common/autotest_common.sh@10 -- # set +x 00:09:49.141 [2024-04-26 17:57:57.687998] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:09:49.141 [2024-04-26 17:57:57.688057] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:49.141 EAL: No free 2048 kB hugepages reported on node 1 00:09:49.141 [2024-04-26 17:57:57.762644] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:49.141 [2024-04-26 17:57:57.847516] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:49.141 [2024-04-26 17:57:57.847561] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:49.141 [2024-04-26 17:57:57.847570] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:49.141 [2024-04-26 17:57:57.847578] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:49.141 [2024-04-26 17:57:57.847585] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:49.141 [2024-04-26 17:57:57.847708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:49.141 [2024-04-26 17:57:57.847784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:49.141 [2024-04-26 17:57:57.847786] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:49.400 17:57:58 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:09:49.400 17:57:58 -- common/autotest_common.sh@860 -- # return 0 00:09:49.400 17:57:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:49.400 17:57:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:09:49.400 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.400 17:57:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:49.400 17:57:58 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -a 256 00:09:49.400 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.400 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.400 [2024-04-26 17:57:58.568505] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x19ead30/0x19ef220) succeed. 00:09:49.400 [2024-04-26 17:57:58.578775] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x19ec2d0/0x1a308b0) succeed. 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 Malloc0 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 Delay0 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 [2024-04-26 17:57:58.743767] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:09:49.660 17:57:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:49.660 17:57:58 -- common/autotest_common.sh@10 -- # set +x 00:09:49.660 17:57:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:49.660 17:57:58 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/abort -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:09:49.660 EAL: No free 2048 kB hugepages reported on node 1 00:09:49.660 [2024-04-26 17:57:58.838525] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:09:52.220 Initializing NVMe Controllers 00:09:52.220 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:09:52.220 controller IO queue size 128 less than required 00:09:52.220 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:09:52.220 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:09:52.220 Initialization complete. Launching workers. 00:09:52.220 NS: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 50716 00:09:52.220 CTRLR: RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 50777, failed to submit 62 00:09:52.220 success 50717, unsuccess 60, failed 0 00:09:52.220 17:58:00 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:09:52.220 17:58:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:09:52.220 17:58:00 -- common/autotest_common.sh@10 -- # set +x 00:09:52.220 17:58:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:09:52.220 17:58:00 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:09:52.220 17:58:00 -- target/abort.sh@38 -- # nvmftestfini 00:09:52.220 17:58:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:09:52.220 17:58:00 -- nvmf/common.sh@117 -- # sync 00:09:52.220 17:58:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:09:52.220 17:58:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:09:52.220 17:58:00 -- nvmf/common.sh@120 -- # set +e 00:09:52.220 17:58:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:09:52.220 17:58:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:09:52.220 rmmod nvme_rdma 00:09:52.220 rmmod nvme_fabrics 00:09:52.220 17:58:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:09:52.220 17:58:01 -- nvmf/common.sh@124 -- # set -e 00:09:52.220 17:58:01 -- nvmf/common.sh@125 -- # return 0 00:09:52.220 17:58:01 -- nvmf/common.sh@478 -- # '[' -n 888002 ']' 00:09:52.220 17:58:01 -- nvmf/common.sh@479 -- # killprocess 888002 00:09:52.220 17:58:01 -- common/autotest_common.sh@946 -- # '[' -z 888002 ']' 00:09:52.220 17:58:01 -- common/autotest_common.sh@950 -- # kill -0 888002 00:09:52.220 17:58:01 -- common/autotest_common.sh@951 -- # uname 00:09:52.220 17:58:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:09:52.220 17:58:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 888002 00:09:52.220 17:58:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:09:52.220 17:58:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:09:52.220 17:58:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 888002' 00:09:52.220 killing process with pid 888002 00:09:52.220 17:58:01 -- common/autotest_common.sh@965 -- # kill 888002 00:09:52.220 17:58:01 -- common/autotest_common.sh@970 -- # wait 888002 00:09:52.220 [2024-04-26 17:58:01.140757] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:09:52.220 17:58:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:09:52.220 17:58:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:09:52.220 00:09:52.220 real 0m10.013s 00:09:52.220 user 0m14.308s 00:09:52.220 sys 0m5.205s 00:09:52.220 17:58:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:09:52.220 17:58:01 -- common/autotest_common.sh@10 -- # set +x 00:09:52.220 ************************************ 00:09:52.220 END TEST nvmf_abort 00:09:52.220 ************************************ 00:09:52.478 17:58:01 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:09:52.478 17:58:01 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:09:52.478 17:58:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:09:52.478 17:58:01 -- common/autotest_common.sh@10 -- # set +x 00:09:52.478 ************************************ 00:09:52.478 START TEST nvmf_ns_hotplug_stress 00:09:52.478 ************************************ 00:09:52.478 17:58:01 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=rdma 00:09:52.478 * Looking for test storage... 00:09:52.478 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:09:52.478 17:58:01 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:09:52.478 17:58:01 -- nvmf/common.sh@7 -- # uname -s 00:09:52.478 17:58:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:52.478 17:58:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:52.478 17:58:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:52.478 17:58:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:52.478 17:58:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:52.478 17:58:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:52.478 17:58:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:52.478 17:58:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:52.478 17:58:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:52.478 17:58:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:52.736 17:58:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:09:52.736 17:58:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:09:52.736 17:58:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:52.736 17:58:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:52.736 17:58:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:52.736 17:58:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:09:52.736 17:58:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:09:52.736 17:58:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:52.736 17:58:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:52.736 17:58:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:52.736 17:58:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.737 17:58:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.737 17:58:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.737 17:58:01 -- paths/export.sh@5 -- # export PATH 00:09:52.737 17:58:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:52.737 17:58:01 -- nvmf/common.sh@47 -- # : 0 00:09:52.737 17:58:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:09:52.737 17:58:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:09:52.737 17:58:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:09:52.737 17:58:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:52.737 17:58:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:52.737 17:58:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:09:52.737 17:58:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:09:52.737 17:58:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:09:52.737 17:58:01 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:09:52.737 17:58:01 -- target/ns_hotplug_stress.sh@13 -- # nvmftestinit 00:09:52.737 17:58:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:09:52.737 17:58:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:52.737 17:58:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:09:52.737 17:58:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:09:52.737 17:58:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:09:52.737 17:58:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:52.737 17:58:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:52.737 17:58:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:52.737 17:58:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:09:52.737 17:58:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:09:52.737 17:58:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:09:52.737 17:58:01 -- common/autotest_common.sh@10 -- # set +x 00:09:58.006 17:58:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:58.006 17:58:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:09:58.006 17:58:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:09:58.006 17:58:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:09:58.006 17:58:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:09:58.006 17:58:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:09:58.006 17:58:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:09:58.006 17:58:06 -- nvmf/common.sh@295 -- # net_devs=() 00:09:58.006 17:58:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:09:58.006 17:58:06 -- nvmf/common.sh@296 -- # e810=() 00:09:58.006 17:58:06 -- nvmf/common.sh@296 -- # local -ga e810 00:09:58.006 17:58:06 -- nvmf/common.sh@297 -- # x722=() 00:09:58.006 17:58:06 -- nvmf/common.sh@297 -- # local -ga x722 00:09:58.006 17:58:06 -- nvmf/common.sh@298 -- # mlx=() 00:09:58.006 17:58:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:09:58.006 17:58:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:58.006 17:58:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:09:58.006 17:58:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:58.006 17:58:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:09:58.006 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:09:58.006 17:58:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:58.006 17:58:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:09:58.006 17:58:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:09:58.006 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:09:58.006 17:58:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:09:58.006 17:58:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:09:58.006 17:58:06 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:58.006 17:58:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:58.006 17:58:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:58.006 17:58:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:58.006 17:58:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:09:58.006 Found net devices under 0000:18:00.0: mlx_0_0 00:09:58.006 17:58:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:09:58.006 17:58:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:58.006 17:58:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:09:58.006 17:58:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:58.006 17:58:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:09:58.006 Found net devices under 0000:18:00.1: mlx_0_1 00:09:58.006 17:58:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:09:58.006 17:58:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:09:58.006 17:58:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:09:58.006 17:58:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:09:58.006 17:58:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:09:58.006 17:58:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:09:58.006 17:58:06 -- nvmf/common.sh@58 -- # uname 00:09:58.006 17:58:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:09:58.006 17:58:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:09:58.006 17:58:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:09:58.006 17:58:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:09:58.006 17:58:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:09:58.006 17:58:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:09:58.006 17:58:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:09:58.006 17:58:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:09:58.006 17:58:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:09:58.006 17:58:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:09:58.006 17:58:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:09:58.006 17:58:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:58.007 17:58:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:58.007 17:58:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:58.007 17:58:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:58.007 17:58:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:58.007 17:58:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@105 -- # continue 2 00:09:58.007 17:58:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@105 -- # continue 2 00:09:58.007 17:58:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:58.007 17:58:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:58.007 17:58:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:09:58.007 17:58:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:09:58.007 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:58.007 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:09:58.007 altname enp24s0f0np0 00:09:58.007 altname ens785f0np0 00:09:58.007 inet 192.168.100.8/24 scope global mlx_0_0 00:09:58.007 valid_lft forever preferred_lft forever 00:09:58.007 17:58:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:09:58.007 17:58:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:58.007 17:58:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:09:58.007 17:58:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:09:58.007 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:09:58.007 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:09:58.007 altname enp24s0f1np1 00:09:58.007 altname ens785f1np1 00:09:58.007 inet 192.168.100.9/24 scope global mlx_0_1 00:09:58.007 valid_lft forever preferred_lft forever 00:09:58.007 17:58:06 -- nvmf/common.sh@411 -- # return 0 00:09:58.007 17:58:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:09:58.007 17:58:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:09:58.007 17:58:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:09:58.007 17:58:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:09:58.007 17:58:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:09:58.007 17:58:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:09:58.007 17:58:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:09:58.007 17:58:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:09:58.007 17:58:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:09:58.007 17:58:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@105 -- # continue 2 00:09:58.007 17:58:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:09:58.007 17:58:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:09:58.007 17:58:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@105 -- # continue 2 00:09:58.007 17:58:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:58.007 17:58:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:58.007 17:58:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:09:58.007 17:58:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:09:58.007 17:58:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:09:58.007 17:58:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:09:58.007 192.168.100.9' 00:09:58.007 17:58:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:09:58.007 192.168.100.9' 00:09:58.007 17:58:06 -- nvmf/common.sh@446 -- # head -n 1 00:09:58.007 17:58:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:09:58.007 17:58:06 -- nvmf/common.sh@447 -- # head -n 1 00:09:58.007 17:58:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:09:58.007 192.168.100.9' 00:09:58.007 17:58:06 -- nvmf/common.sh@447 -- # tail -n +2 00:09:58.007 17:58:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:09:58.007 17:58:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:09:58.007 17:58:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:09:58.007 17:58:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:09:58.007 17:58:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:09:58.007 17:58:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:09:58.007 17:58:07 -- target/ns_hotplug_stress.sh@14 -- # nvmfappstart -m 0xE 00:09:58.007 17:58:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:09:58.007 17:58:07 -- common/autotest_common.sh@720 -- # xtrace_disable 00:09:58.007 17:58:07 -- common/autotest_common.sh@10 -- # set +x 00:09:58.007 17:58:07 -- nvmf/common.sh@470 -- # nvmfpid=891263 00:09:58.007 17:58:07 -- nvmf/common.sh@471 -- # waitforlisten 891263 00:09:58.007 17:58:07 -- common/autotest_common.sh@827 -- # '[' -z 891263 ']' 00:09:58.007 17:58:07 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:58.007 17:58:07 -- common/autotest_common.sh@832 -- # local max_retries=100 00:09:58.007 17:58:07 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:58.007 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:58.007 17:58:07 -- common/autotest_common.sh@836 -- # xtrace_disable 00:09:58.007 17:58:07 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:09:58.007 17:58:07 -- common/autotest_common.sh@10 -- # set +x 00:09:58.007 [2024-04-26 17:58:07.062976] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:09:58.007 [2024-04-26 17:58:07.063028] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:58.007 EAL: No free 2048 kB hugepages reported on node 1 00:09:58.007 [2024-04-26 17:58:07.133091] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:09:58.266 [2024-04-26 17:58:07.218128] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:58.267 [2024-04-26 17:58:07.218164] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:58.267 [2024-04-26 17:58:07.218173] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:09:58.267 [2024-04-26 17:58:07.218182] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:09:58.267 [2024-04-26 17:58:07.218189] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:58.267 [2024-04-26 17:58:07.218285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:58.267 [2024-04-26 17:58:07.218366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:58.267 [2024-04-26 17:58:07.218369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:58.833 17:58:07 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:09:58.833 17:58:07 -- common/autotest_common.sh@860 -- # return 0 00:09:58.833 17:58:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:09:58.833 17:58:07 -- common/autotest_common.sh@726 -- # xtrace_disable 00:09:58.833 17:58:07 -- common/autotest_common.sh@10 -- # set +x 00:09:58.833 17:58:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:58.833 17:58:07 -- target/ns_hotplug_stress.sh@16 -- # null_size=1000 00:09:58.833 17:58:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:09:59.092 [2024-04-26 17:58:08.096838] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a4fd30/0x1a54220) succeed. 00:09:59.092 [2024-04-26 17:58:08.107237] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a512d0/0x1a958b0) succeed. 00:09:59.092 17:58:08 -- target/ns_hotplug_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:09:59.350 17:58:08 -- target/ns_hotplug_stress.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:09:59.609 [2024-04-26 17:58:08.593572] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:09:59.609 17:58:08 -- target/ns_hotplug_stress.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:09:59.868 17:58:08 -- target/ns_hotplug_stress.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:09:59.868 Malloc0 00:09:59.868 17:58:08 -- target/ns_hotplug_stress.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:10:00.127 Delay0 00:10:00.127 17:58:09 -- target/ns_hotplug_stress.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:00.386 17:58:09 -- target/ns_hotplug_stress.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:10:00.386 NULL1 00:10:00.386 17:58:09 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:10:00.645 17:58:09 -- target/ns_hotplug_stress.sh@33 -- # PERF_PID=891649 00:10:00.645 17:58:09 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:10:00.645 17:58:09 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:00.645 17:58:09 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:00.645 EAL: No free 2048 kB hugepages reported on node 1 00:10:02.022 Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 17:58:10 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:02.022 17:58:11 -- target/ns_hotplug_stress.sh@40 -- # null_size=1001 00:10:02.022 17:58:11 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:10:02.281 true 00:10:02.281 17:58:11 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:02.281 17:58:11 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 17:58:12 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:03.219 17:58:12 -- target/ns_hotplug_stress.sh@40 -- # null_size=1002 00:10:03.219 17:58:12 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:10:03.478 true 00:10:03.478 17:58:12 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:03.478 17:58:12 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 17:58:13 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:04.415 17:58:13 -- target/ns_hotplug_stress.sh@40 -- # null_size=1003 00:10:04.415 17:58:13 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:10:04.674 true 00:10:04.674 17:58:13 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:04.674 17:58:13 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:05.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.608 17:58:14 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:05.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.608 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:05.609 17:58:14 -- target/ns_hotplug_stress.sh@40 -- # null_size=1004 00:10:05.609 17:58:14 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:10:05.867 true 00:10:05.867 17:58:14 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:05.867 17:58:14 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 17:58:15 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:06.805 17:58:15 -- target/ns_hotplug_stress.sh@40 -- # null_size=1005 00:10:06.805 17:58:15 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:10:07.065 true 00:10:07.065 17:58:16 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:07.065 17:58:16 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:08.001 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.001 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.001 17:58:16 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:08.001 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:08.001 17:58:17 -- target/ns_hotplug_stress.sh@40 -- # null_size=1006 00:10:08.001 17:58:17 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:10:08.260 true 00:10:08.260 17:58:17 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:08.260 17:58:17 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 17:58:18 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:09.197 17:58:18 -- target/ns_hotplug_stress.sh@40 -- # null_size=1007 00:10:09.197 17:58:18 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:10:09.455 true 00:10:09.455 17:58:18 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:09.456 17:58:18 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 17:58:19 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:10.447 17:58:19 -- target/ns_hotplug_stress.sh@40 -- # null_size=1008 00:10:10.447 17:58:19 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:10:10.705 true 00:10:10.705 17:58:19 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:10.705 17:58:19 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 17:58:20 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:11.647 17:58:20 -- target/ns_hotplug_stress.sh@40 -- # null_size=1009 00:10:11.647 17:58:20 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:10:11.905 true 00:10:11.905 17:58:20 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:11.905 17:58:20 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 17:58:21 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:12.842 17:58:21 -- target/ns_hotplug_stress.sh@40 -- # null_size=1010 00:10:12.842 17:58:21 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:10:13.100 true 00:10:13.100 17:58:22 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:13.100 17:58:22 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:14.035 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.035 17:58:22 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:14.035 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.035 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.035 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.035 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:14.035 17:58:23 -- target/ns_hotplug_stress.sh@40 -- # null_size=1011 00:10:14.035 17:58:23 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:10:14.293 true 00:10:14.293 17:58:23 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:14.293 17:58:23 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 17:58:24 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:15.228 17:58:24 -- target/ns_hotplug_stress.sh@40 -- # null_size=1012 00:10:15.228 17:58:24 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:10:15.487 true 00:10:15.487 17:58:24 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:15.487 17:58:24 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 17:58:25 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:16.424 17:58:25 -- target/ns_hotplug_stress.sh@40 -- # null_size=1013 00:10:16.424 17:58:25 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:10:16.682 true 00:10:16.682 17:58:25 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:16.682 17:58:25 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 17:58:26 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:17.619 17:58:26 -- target/ns_hotplug_stress.sh@40 -- # null_size=1014 00:10:17.619 17:58:26 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:10:17.878 true 00:10:17.878 17:58:26 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:17.878 17:58:26 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 17:58:27 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:18.815 17:58:27 -- target/ns_hotplug_stress.sh@40 -- # null_size=1015 00:10:18.815 17:58:27 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:10:19.073 true 00:10:19.073 17:58:28 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:19.073 17:58:28 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 17:58:28 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:20.010 17:58:29 -- target/ns_hotplug_stress.sh@40 -- # null_size=1016 00:10:20.010 17:58:29 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:10:20.268 true 00:10:20.268 17:58:29 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:20.268 17:58:29 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.204 17:58:30 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.204 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:21.463 17:58:30 -- target/ns_hotplug_stress.sh@40 -- # null_size=1017 00:10:21.463 17:58:30 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:10:21.463 true 00:10:21.721 17:58:30 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:21.721 17:58:30 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:22.288 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 17:58:31 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:22.546 17:58:31 -- target/ns_hotplug_stress.sh@40 -- # null_size=1018 00:10:22.546 17:58:31 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:10:22.805 true 00:10:22.805 17:58:31 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:22.805 17:58:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 17:58:32 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:23.741 17:58:32 -- target/ns_hotplug_stress.sh@40 -- # null_size=1019 00:10:23.741 17:58:32 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:10:23.999 true 00:10:23.999 17:58:33 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:23.999 17:58:33 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 17:58:33 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:24.934 17:58:34 -- target/ns_hotplug_stress.sh@40 -- # null_size=1020 00:10:24.934 17:58:34 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:10:25.193 true 00:10:25.193 17:58:34 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:25.193 17:58:34 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:26.128 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:26.129 17:58:35 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:26.129 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:26.129 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:26.129 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:26.129 17:58:35 -- target/ns_hotplug_stress.sh@40 -- # null_size=1021 00:10:26.129 17:58:35 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:10:26.387 true 00:10:26.387 17:58:35 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:26.387 17:58:35 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 17:58:36 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.322 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:27.581 17:58:36 -- target/ns_hotplug_stress.sh@40 -- # null_size=1022 00:10:27.581 17:58:36 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:10:27.581 true 00:10:27.581 17:58:36 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:27.581 17:58:36 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 17:58:37 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.515 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.773 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:28.773 17:58:37 -- target/ns_hotplug_stress.sh@40 -- # null_size=1023 00:10:28.773 17:58:37 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:10:28.773 true 00:10:28.773 17:58:37 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:28.773 17:58:37 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 17:58:38 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.709 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:29.968 17:58:38 -- target/ns_hotplug_stress.sh@40 -- # null_size=1024 00:10:29.968 17:58:38 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:10:29.968 true 00:10:29.968 17:58:39 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:29.968 17:58:39 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:30.913 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:30.913 17:58:39 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:30.913 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:10:31.184 17:58:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1025 00:10:31.184 17:58:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:10:31.184 true 00:10:31.184 17:58:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:31.184 17:58:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:31.516 17:58:40 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:31.774 17:58:40 -- target/ns_hotplug_stress.sh@40 -- # null_size=1026 00:10:31.774 17:58:40 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:10:31.774 true 00:10:31.774 17:58:40 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:31.774 17:58:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:32.033 17:58:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:32.292 17:58:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1027 00:10:32.292 17:58:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:10:32.292 true 00:10:32.292 17:58:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:32.292 17:58:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:32.549 17:58:41 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:32.808 17:58:41 -- target/ns_hotplug_stress.sh@40 -- # null_size=1028 00:10:32.808 17:58:41 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:10:32.808 true 00:10:32.808 17:58:41 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:32.808 17:58:41 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:10:33.067 Initializing NVMe Controllers 00:10:33.067 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:33.067 Controller IO queue size 128, less than required. 00:10:33.067 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:33.067 Controller IO queue size 128, less than required. 00:10:33.067 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:10:33.067 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:10:33.067 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:10:33.067 Initialization complete. Launching workers. 00:10:33.067 ======================================================== 00:10:33.067 Latency(us) 00:10:33.067 Device Information : IOPS MiB/s Average min max 00:10:33.067 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5930.93 2.90 18806.65 800.95 1137825.52 00:10:33.067 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 33625.83 16.42 3806.55 2310.32 293374.32 00:10:33.067 ======================================================== 00:10:33.067 Total : 39556.77 19.31 6055.59 800.95 1137825.52 00:10:33.067 00:10:33.067 17:58:42 -- target/ns_hotplug_stress.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:10:33.326 17:58:42 -- target/ns_hotplug_stress.sh@40 -- # null_size=1029 00:10:33.326 17:58:42 -- target/ns_hotplug_stress.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:10:33.585 true 00:10:33.585 17:58:42 -- target/ns_hotplug_stress.sh@35 -- # kill -0 891649 00:10:33.585 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 35: kill: (891649) - No such process 00:10:33.585 17:58:42 -- target/ns_hotplug_stress.sh@44 -- # wait 891649 00:10:33.585 17:58:42 -- target/ns_hotplug_stress.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:10:33.585 17:58:42 -- target/ns_hotplug_stress.sh@48 -- # nvmftestfini 00:10:33.585 17:58:42 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:33.585 17:58:42 -- nvmf/common.sh@117 -- # sync 00:10:33.585 17:58:42 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:33.585 17:58:42 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:33.585 17:58:42 -- nvmf/common.sh@120 -- # set +e 00:10:33.585 17:58:42 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:33.585 17:58:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:33.585 rmmod nvme_rdma 00:10:33.585 rmmod nvme_fabrics 00:10:33.585 17:58:42 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:33.585 17:58:42 -- nvmf/common.sh@124 -- # set -e 00:10:33.585 17:58:42 -- nvmf/common.sh@125 -- # return 0 00:10:33.585 17:58:42 -- nvmf/common.sh@478 -- # '[' -n 891263 ']' 00:10:33.585 17:58:42 -- nvmf/common.sh@479 -- # killprocess 891263 00:10:33.585 17:58:42 -- common/autotest_common.sh@946 -- # '[' -z 891263 ']' 00:10:33.585 17:58:42 -- common/autotest_common.sh@950 -- # kill -0 891263 00:10:33.585 17:58:42 -- common/autotest_common.sh@951 -- # uname 00:10:33.585 17:58:42 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:10:33.585 17:58:42 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 891263 00:10:33.585 17:58:42 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:10:33.585 17:58:42 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:10:33.585 17:58:42 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 891263' 00:10:33.585 killing process with pid 891263 00:10:33.585 17:58:42 -- common/autotest_common.sh@965 -- # kill 891263 00:10:33.585 17:58:42 -- common/autotest_common.sh@970 -- # wait 891263 00:10:33.585 [2024-04-26 17:58:42.724113] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:33.844 17:58:42 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:33.844 17:58:42 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:33.844 00:10:33.844 real 0m41.355s 00:10:33.844 user 2m34.645s 00:10:33.844 sys 0m7.942s 00:10:33.844 17:58:42 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:10:33.844 17:58:42 -- common/autotest_common.sh@10 -- # set +x 00:10:33.844 ************************************ 00:10:33.844 END TEST nvmf_ns_hotplug_stress 00:10:33.844 ************************************ 00:10:33.844 17:58:42 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:10:33.844 17:58:42 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:10:33.844 17:58:42 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:10:33.844 17:58:42 -- common/autotest_common.sh@10 -- # set +x 00:10:34.104 ************************************ 00:10:34.104 START TEST nvmf_connect_stress 00:10:34.104 ************************************ 00:10:34.104 17:58:43 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=rdma 00:10:34.104 * Looking for test storage... 00:10:34.104 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:34.104 17:58:43 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:34.104 17:58:43 -- nvmf/common.sh@7 -- # uname -s 00:10:34.104 17:58:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:34.104 17:58:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:34.105 17:58:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:34.105 17:58:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:34.105 17:58:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:34.105 17:58:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:34.105 17:58:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:34.105 17:58:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:34.105 17:58:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:34.105 17:58:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:34.105 17:58:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:34.105 17:58:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:10:34.105 17:58:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:34.105 17:58:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:34.105 17:58:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:34.105 17:58:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:34.105 17:58:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:34.105 17:58:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:34.105 17:58:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:34.105 17:58:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:34.105 17:58:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:34.105 17:58:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:34.105 17:58:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:34.105 17:58:43 -- paths/export.sh@5 -- # export PATH 00:10:34.105 17:58:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:34.105 17:58:43 -- nvmf/common.sh@47 -- # : 0 00:10:34.105 17:58:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:34.105 17:58:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:34.105 17:58:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:34.105 17:58:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:34.105 17:58:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:34.105 17:58:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:34.105 17:58:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:34.105 17:58:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:34.363 17:58:43 -- target/connect_stress.sh@12 -- # nvmftestinit 00:10:34.363 17:58:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:34.363 17:58:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:34.363 17:58:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:34.363 17:58:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:34.363 17:58:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:34.363 17:58:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:34.363 17:58:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:34.363 17:58:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:34.363 17:58:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:34.363 17:58:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:34.363 17:58:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:34.363 17:58:43 -- common/autotest_common.sh@10 -- # set +x 00:10:40.929 17:58:49 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:40.929 17:58:49 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:40.929 17:58:49 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:40.929 17:58:49 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:40.929 17:58:49 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:40.929 17:58:49 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:40.929 17:58:49 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:40.929 17:58:49 -- nvmf/common.sh@295 -- # net_devs=() 00:10:40.929 17:58:49 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:40.929 17:58:49 -- nvmf/common.sh@296 -- # e810=() 00:10:40.929 17:58:49 -- nvmf/common.sh@296 -- # local -ga e810 00:10:40.929 17:58:49 -- nvmf/common.sh@297 -- # x722=() 00:10:40.929 17:58:49 -- nvmf/common.sh@297 -- # local -ga x722 00:10:40.929 17:58:49 -- nvmf/common.sh@298 -- # mlx=() 00:10:40.929 17:58:49 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:40.929 17:58:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:40.929 17:58:49 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:40.929 17:58:49 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:40.929 17:58:49 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:40.929 17:58:49 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:40.929 17:58:49 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:40.929 17:58:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:40.929 17:58:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:40.929 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:40.929 17:58:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:40.929 17:58:49 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:40.929 17:58:49 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:40.929 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:40.929 17:58:49 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:40.929 17:58:49 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:40.929 17:58:49 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:40.930 17:58:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:40.930 17:58:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:40.930 Found net devices under 0000:18:00.0: mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:40.930 17:58:49 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:40.930 17:58:49 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:40.930 17:58:49 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:40.930 Found net devices under 0000:18:00.1: mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:40.930 17:58:49 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:40.930 17:58:49 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:40.930 17:58:49 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:40.930 17:58:49 -- nvmf/common.sh@58 -- # uname 00:10:40.930 17:58:49 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:40.930 17:58:49 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:40.930 17:58:49 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:40.930 17:58:49 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:40.930 17:58:49 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:40.930 17:58:49 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:40.930 17:58:49 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:40.930 17:58:49 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:40.930 17:58:49 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:40.930 17:58:49 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:40.930 17:58:49 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:40.930 17:58:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:40.930 17:58:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:40.930 17:58:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:40.930 17:58:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:40.930 17:58:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@105 -- # continue 2 00:10:40.930 17:58:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@105 -- # continue 2 00:10:40.930 17:58:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:40.930 17:58:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.930 17:58:49 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:40.930 17:58:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:40.930 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:40.930 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:10:40.930 altname enp24s0f0np0 00:10:40.930 altname ens785f0np0 00:10:40.930 inet 192.168.100.8/24 scope global mlx_0_0 00:10:40.930 valid_lft forever preferred_lft forever 00:10:40.930 17:58:49 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:40.930 17:58:49 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.930 17:58:49 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:40.930 17:58:49 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:40.930 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:40.930 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:10:40.930 altname enp24s0f1np1 00:10:40.930 altname ens785f1np1 00:10:40.930 inet 192.168.100.9/24 scope global mlx_0_1 00:10:40.930 valid_lft forever preferred_lft forever 00:10:40.930 17:58:49 -- nvmf/common.sh@411 -- # return 0 00:10:40.930 17:58:49 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:40.930 17:58:49 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:40.930 17:58:49 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:40.930 17:58:49 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:40.930 17:58:49 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:40.930 17:58:49 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:40.930 17:58:49 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:40.930 17:58:49 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:40.930 17:58:49 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:40.930 17:58:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@105 -- # continue 2 00:10:40.930 17:58:49 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:40.930 17:58:49 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:40.930 17:58:49 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@105 -- # continue 2 00:10:40.930 17:58:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:40.930 17:58:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.930 17:58:49 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:40.930 17:58:49 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:40.930 17:58:49 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:40.930 17:58:49 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:40.930 192.168.100.9' 00:10:40.930 17:58:49 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:40.930 192.168.100.9' 00:10:40.930 17:58:49 -- nvmf/common.sh@446 -- # head -n 1 00:10:40.930 17:58:49 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:40.930 17:58:49 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:40.930 192.168.100.9' 00:10:40.930 17:58:49 -- nvmf/common.sh@447 -- # tail -n +2 00:10:40.930 17:58:49 -- nvmf/common.sh@447 -- # head -n 1 00:10:40.930 17:58:49 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:40.930 17:58:49 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:40.930 17:58:49 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:40.930 17:58:49 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:40.931 17:58:49 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:40.931 17:58:49 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:40.931 17:58:49 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:10:40.931 17:58:49 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:40.931 17:58:49 -- common/autotest_common.sh@720 -- # xtrace_disable 00:10:40.931 17:58:49 -- common/autotest_common.sh@10 -- # set +x 00:10:40.931 17:58:49 -- nvmf/common.sh@470 -- # nvmfpid=899024 00:10:40.931 17:58:49 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:10:40.931 17:58:49 -- nvmf/common.sh@471 -- # waitforlisten 899024 00:10:40.931 17:58:49 -- common/autotest_common.sh@827 -- # '[' -z 899024 ']' 00:10:40.931 17:58:49 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:40.931 17:58:49 -- common/autotest_common.sh@832 -- # local max_retries=100 00:10:40.931 17:58:49 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:40.931 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:40.931 17:58:49 -- common/autotest_common.sh@836 -- # xtrace_disable 00:10:40.931 17:58:49 -- common/autotest_common.sh@10 -- # set +x 00:10:40.931 [2024-04-26 17:58:49.499514] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:10:40.931 [2024-04-26 17:58:49.499574] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:40.931 EAL: No free 2048 kB hugepages reported on node 1 00:10:40.931 [2024-04-26 17:58:49.575456] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:10:40.931 [2024-04-26 17:58:49.666234] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:40.931 [2024-04-26 17:58:49.666276] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:40.931 [2024-04-26 17:58:49.666286] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:40.931 [2024-04-26 17:58:49.666296] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:40.931 [2024-04-26 17:58:49.666303] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:40.931 [2024-04-26 17:58:49.666361] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:10:40.931 [2024-04-26 17:58:49.666441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:10:40.931 [2024-04-26 17:58:49.666443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:10:41.190 17:58:50 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:10:41.190 17:58:50 -- common/autotest_common.sh@860 -- # return 0 00:10:41.190 17:58:50 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:10:41.190 17:58:50 -- common/autotest_common.sh@726 -- # xtrace_disable 00:10:41.190 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.190 17:58:50 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:10:41.190 17:58:50 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:10:41.190 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.190 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.449 [2024-04-26 17:58:50.385300] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xc57d30/0xc5c220) succeed. 00:10:41.449 [2024-04-26 17:58:50.395505] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xc592d0/0xc9d8b0) succeed. 00:10:41.449 17:58:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:41.449 17:58:50 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:10:41.449 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.449 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.449 17:58:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:41.449 17:58:50 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:10:41.449 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.449 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.449 [2024-04-26 17:58:50.520794] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:10:41.449 17:58:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:41.449 17:58:50 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:10:41.449 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.449 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.449 NULL1 00:10:41.449 17:58:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:41.449 17:58:50 -- target/connect_stress.sh@21 -- # PERF_PID=899111 00:10:41.449 17:58:50 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:41.449 17:58:50 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:10:41.449 17:58:50 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # seq 1 20 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 EAL: No free 2048 kB hugepages reported on node 1 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.449 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.449 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.708 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.708 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.708 17:58:50 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:10:41.708 17:58:50 -- target/connect_stress.sh@28 -- # cat 00:10:41.708 17:58:50 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:41.708 17:58:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.708 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.708 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:41.967 17:58:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:41.967 17:58:50 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:41.967 17:58:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:41.967 17:58:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:41.967 17:58:50 -- common/autotest_common.sh@10 -- # set +x 00:10:42.225 17:58:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:42.225 17:58:51 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:42.225 17:58:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:42.225 17:58:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:42.225 17:58:51 -- common/autotest_common.sh@10 -- # set +x 00:10:42.484 17:58:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:42.484 17:58:51 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:42.484 17:58:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:42.484 17:58:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:42.484 17:58:51 -- common/autotest_common.sh@10 -- # set +x 00:10:43.051 17:58:51 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:43.051 17:58:51 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:43.051 17:58:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.051 17:58:51 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:43.051 17:58:51 -- common/autotest_common.sh@10 -- # set +x 00:10:43.310 17:58:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:43.310 17:58:52 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:43.310 17:58:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.310 17:58:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:43.310 17:58:52 -- common/autotest_common.sh@10 -- # set +x 00:10:43.569 17:58:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:43.569 17:58:52 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:43.569 17:58:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.569 17:58:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:43.569 17:58:52 -- common/autotest_common.sh@10 -- # set +x 00:10:43.827 17:58:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:43.827 17:58:52 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:43.827 17:58:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:43.827 17:58:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:43.827 17:58:52 -- common/autotest_common.sh@10 -- # set +x 00:10:44.084 17:58:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:44.084 17:58:53 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:44.084 17:58:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:44.084 17:58:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:44.084 17:58:53 -- common/autotest_common.sh@10 -- # set +x 00:10:44.651 17:58:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:44.651 17:58:53 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:44.651 17:58:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:44.651 17:58:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:44.651 17:58:53 -- common/autotest_common.sh@10 -- # set +x 00:10:44.910 17:58:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:44.910 17:58:53 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:44.910 17:58:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:44.910 17:58:53 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:44.910 17:58:53 -- common/autotest_common.sh@10 -- # set +x 00:10:45.168 17:58:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:45.168 17:58:54 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:45.168 17:58:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:45.168 17:58:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:45.168 17:58:54 -- common/autotest_common.sh@10 -- # set +x 00:10:45.427 17:58:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:45.427 17:58:54 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:45.427 17:58:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:45.427 17:58:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:45.427 17:58:54 -- common/autotest_common.sh@10 -- # set +x 00:10:45.686 17:58:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:45.686 17:58:54 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:45.686 17:58:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:45.686 17:58:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:45.686 17:58:54 -- common/autotest_common.sh@10 -- # set +x 00:10:46.253 17:58:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:46.253 17:58:55 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:46.253 17:58:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:46.253 17:58:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:46.253 17:58:55 -- common/autotest_common.sh@10 -- # set +x 00:10:46.512 17:58:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:46.512 17:58:55 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:46.512 17:58:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:46.512 17:58:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:46.512 17:58:55 -- common/autotest_common.sh@10 -- # set +x 00:10:46.770 17:58:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:46.770 17:58:55 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:46.770 17:58:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:46.770 17:58:55 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:46.770 17:58:55 -- common/autotest_common.sh@10 -- # set +x 00:10:47.029 17:58:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:47.029 17:58:56 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:47.029 17:58:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:47.029 17:58:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:47.029 17:58:56 -- common/autotest_common.sh@10 -- # set +x 00:10:47.595 17:58:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:47.595 17:58:56 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:47.595 17:58:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:47.595 17:58:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:47.595 17:58:56 -- common/autotest_common.sh@10 -- # set +x 00:10:47.854 17:58:56 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:47.854 17:58:56 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:47.854 17:58:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:47.854 17:58:56 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:47.854 17:58:56 -- common/autotest_common.sh@10 -- # set +x 00:10:48.112 17:58:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:48.112 17:58:57 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:48.112 17:58:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:48.112 17:58:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:48.112 17:58:57 -- common/autotest_common.sh@10 -- # set +x 00:10:48.370 17:58:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:48.370 17:58:57 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:48.370 17:58:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:48.370 17:58:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:48.370 17:58:57 -- common/autotest_common.sh@10 -- # set +x 00:10:48.629 17:58:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:48.629 17:58:57 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:48.629 17:58:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:48.629 17:58:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:48.629 17:58:57 -- common/autotest_common.sh@10 -- # set +x 00:10:49.197 17:58:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.197 17:58:58 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:49.197 17:58:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:49.197 17:58:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.197 17:58:58 -- common/autotest_common.sh@10 -- # set +x 00:10:49.455 17:58:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.455 17:58:58 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:49.455 17:58:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:49.455 17:58:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.455 17:58:58 -- common/autotest_common.sh@10 -- # set +x 00:10:49.714 17:58:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.714 17:58:58 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:49.714 17:58:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:49.714 17:58:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.714 17:58:58 -- common/autotest_common.sh@10 -- # set +x 00:10:49.973 17:58:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:49.973 17:58:59 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:49.973 17:58:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:49.973 17:58:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:49.973 17:58:59 -- common/autotest_common.sh@10 -- # set +x 00:10:50.541 17:58:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:50.541 17:58:59 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:50.541 17:58:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:50.541 17:58:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:50.541 17:58:59 -- common/autotest_common.sh@10 -- # set +x 00:10:50.800 17:58:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:50.800 17:58:59 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:50.800 17:58:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:50.800 17:58:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:50.800 17:58:59 -- common/autotest_common.sh@10 -- # set +x 00:10:51.068 17:59:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:51.068 17:59:00 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:51.069 17:59:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:51.069 17:59:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:51.069 17:59:00 -- common/autotest_common.sh@10 -- # set +x 00:10:51.331 17:59:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:51.331 17:59:00 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:51.331 17:59:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:51.331 17:59:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:51.331 17:59:00 -- common/autotest_common.sh@10 -- # set +x 00:10:51.589 Testing NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:10:51.589 17:59:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:51.589 17:59:00 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:51.589 17:59:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:10:51.589 17:59:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:10:51.589 17:59:00 -- common/autotest_common.sh@10 -- # set +x 00:10:52.157 17:59:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:10:52.157 17:59:01 -- target/connect_stress.sh@34 -- # kill -0 899111 00:10:52.157 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (899111) - No such process 00:10:52.157 17:59:01 -- target/connect_stress.sh@38 -- # wait 899111 00:10:52.157 17:59:01 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:10:52.157 17:59:01 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:10:52.157 17:59:01 -- target/connect_stress.sh@43 -- # nvmftestfini 00:10:52.157 17:59:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:10:52.157 17:59:01 -- nvmf/common.sh@117 -- # sync 00:10:52.157 17:59:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:10:52.157 17:59:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:10:52.157 17:59:01 -- nvmf/common.sh@120 -- # set +e 00:10:52.157 17:59:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:10:52.157 17:59:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:10:52.157 rmmod nvme_rdma 00:10:52.157 rmmod nvme_fabrics 00:10:52.157 17:59:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:10:52.157 17:59:01 -- nvmf/common.sh@124 -- # set -e 00:10:52.157 17:59:01 -- nvmf/common.sh@125 -- # return 0 00:10:52.157 17:59:01 -- nvmf/common.sh@478 -- # '[' -n 899024 ']' 00:10:52.157 17:59:01 -- nvmf/common.sh@479 -- # killprocess 899024 00:10:52.157 17:59:01 -- common/autotest_common.sh@946 -- # '[' -z 899024 ']' 00:10:52.157 17:59:01 -- common/autotest_common.sh@950 -- # kill -0 899024 00:10:52.157 17:59:01 -- common/autotest_common.sh@951 -- # uname 00:10:52.157 17:59:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:10:52.157 17:59:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 899024 00:10:52.157 17:59:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:10:52.157 17:59:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:10:52.157 17:59:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 899024' 00:10:52.157 killing process with pid 899024 00:10:52.157 17:59:01 -- common/autotest_common.sh@965 -- # kill 899024 00:10:52.157 17:59:01 -- common/autotest_common.sh@970 -- # wait 899024 00:10:52.157 [2024-04-26 17:59:01.250787] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:10:52.416 17:59:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:10:52.416 17:59:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:10:52.416 00:10:52.416 real 0m18.333s 00:10:52.416 user 0m42.542s 00:10:52.416 sys 0m7.382s 00:10:52.416 17:59:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:10:52.416 17:59:01 -- common/autotest_common.sh@10 -- # set +x 00:10:52.416 ************************************ 00:10:52.416 END TEST nvmf_connect_stress 00:10:52.416 ************************************ 00:10:52.416 17:59:01 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:10:52.416 17:59:01 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:10:52.416 17:59:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:10:52.416 17:59:01 -- common/autotest_common.sh@10 -- # set +x 00:10:52.675 ************************************ 00:10:52.675 START TEST nvmf_fused_ordering 00:10:52.675 ************************************ 00:10:52.675 17:59:01 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=rdma 00:10:52.675 * Looking for test storage... 00:10:52.675 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:10:52.675 17:59:01 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:10:52.675 17:59:01 -- nvmf/common.sh@7 -- # uname -s 00:10:52.675 17:59:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:10:52.675 17:59:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:10:52.675 17:59:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:10:52.675 17:59:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:10:52.675 17:59:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:10:52.675 17:59:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:10:52.675 17:59:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:10:52.675 17:59:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:10:52.675 17:59:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:10:52.675 17:59:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:10:52.675 17:59:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:10:52.675 17:59:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:10:52.676 17:59:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:10:52.676 17:59:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:10:52.676 17:59:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:10:52.676 17:59:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:10:52.676 17:59:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:10:52.676 17:59:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:10:52.676 17:59:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:10:52.676 17:59:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:10:52.676 17:59:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.676 17:59:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.676 17:59:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.676 17:59:01 -- paths/export.sh@5 -- # export PATH 00:10:52.676 17:59:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:10:52.676 17:59:01 -- nvmf/common.sh@47 -- # : 0 00:10:52.676 17:59:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:10:52.676 17:59:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:10:52.676 17:59:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:10:52.676 17:59:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:10:52.676 17:59:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:10:52.676 17:59:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:10:52.676 17:59:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:10:52.676 17:59:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:10:52.676 17:59:01 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:10:52.676 17:59:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:10:52.676 17:59:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:10:52.676 17:59:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:10:52.676 17:59:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:10:52.676 17:59:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:10:52.676 17:59:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:10:52.676 17:59:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:10:52.676 17:59:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:10:52.676 17:59:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:10:52.676 17:59:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:10:52.676 17:59:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:10:52.676 17:59:01 -- common/autotest_common.sh@10 -- # set +x 00:10:59.286 17:59:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:10:59.286 17:59:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:10:59.286 17:59:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:10:59.286 17:59:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:10:59.286 17:59:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:10:59.286 17:59:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:10:59.286 17:59:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:10:59.286 17:59:08 -- nvmf/common.sh@295 -- # net_devs=() 00:10:59.286 17:59:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:10:59.286 17:59:08 -- nvmf/common.sh@296 -- # e810=() 00:10:59.286 17:59:08 -- nvmf/common.sh@296 -- # local -ga e810 00:10:59.286 17:59:08 -- nvmf/common.sh@297 -- # x722=() 00:10:59.286 17:59:08 -- nvmf/common.sh@297 -- # local -ga x722 00:10:59.286 17:59:08 -- nvmf/common.sh@298 -- # mlx=() 00:10:59.286 17:59:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:10:59.286 17:59:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:10:59.286 17:59:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:10:59.286 17:59:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:10:59.286 17:59:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:10:59.286 17:59:08 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:10:59.286 17:59:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:10:59.286 17:59:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.286 17:59:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:10:59.286 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:10:59.286 17:59:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:59.286 17:59:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.286 17:59:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:10:59.287 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:10:59.287 17:59:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:10:59.287 17:59:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.287 17:59:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.287 17:59:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:10:59.287 Found net devices under 0000:18:00.0: mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.287 17:59:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:10:59.287 17:59:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:10:59.287 17:59:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:10:59.287 Found net devices under 0000:18:00.1: mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:10:59.287 17:59:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:10:59.287 17:59:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:10:59.287 17:59:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:10:59.287 17:59:08 -- nvmf/common.sh@58 -- # uname 00:10:59.287 17:59:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:10:59.287 17:59:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:10:59.287 17:59:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:10:59.287 17:59:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:10:59.287 17:59:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:10:59.287 17:59:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:10:59.287 17:59:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:10:59.287 17:59:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:10:59.287 17:59:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:10:59.287 17:59:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:10:59.287 17:59:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:10:59.287 17:59:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.287 17:59:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.287 17:59:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.287 17:59:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.287 17:59:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@105 -- # continue 2 00:10:59.287 17:59:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@105 -- # continue 2 00:10:59.287 17:59:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.287 17:59:08 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.287 17:59:08 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:10:59.287 17:59:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:10:59.287 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.287 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:10:59.287 altname enp24s0f0np0 00:10:59.287 altname ens785f0np0 00:10:59.287 inet 192.168.100.8/24 scope global mlx_0_0 00:10:59.287 valid_lft forever preferred_lft forever 00:10:59.287 17:59:08 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:10:59.287 17:59:08 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.287 17:59:08 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:10:59.287 17:59:08 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:10:59.287 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:10:59.287 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:10:59.287 altname enp24s0f1np1 00:10:59.287 altname ens785f1np1 00:10:59.287 inet 192.168.100.9/24 scope global mlx_0_1 00:10:59.287 valid_lft forever preferred_lft forever 00:10:59.287 17:59:08 -- nvmf/common.sh@411 -- # return 0 00:10:59.287 17:59:08 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:10:59.287 17:59:08 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:10:59.287 17:59:08 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:10:59.287 17:59:08 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:10:59.287 17:59:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:10:59.287 17:59:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:10:59.287 17:59:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:10:59.287 17:59:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:10:59.287 17:59:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:10:59.287 17:59:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@105 -- # continue 2 00:10:59.287 17:59:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:10:59.287 17:59:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:10:59.287 17:59:08 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@105 -- # continue 2 00:10:59.287 17:59:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.287 17:59:08 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.287 17:59:08 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:10:59.287 17:59:08 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:10:59.287 17:59:08 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:10:59.288 17:59:08 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:10:59.288 17:59:08 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:10:59.288 192.168.100.9' 00:10:59.288 17:59:08 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:10:59.288 192.168.100.9' 00:10:59.288 17:59:08 -- nvmf/common.sh@446 -- # head -n 1 00:10:59.288 17:59:08 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:10:59.288 17:59:08 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:10:59.288 192.168.100.9' 00:10:59.288 17:59:08 -- nvmf/common.sh@447 -- # tail -n +2 00:10:59.288 17:59:08 -- nvmf/common.sh@447 -- # head -n 1 00:10:59.288 17:59:08 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:10:59.288 17:59:08 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:10:59.288 17:59:08 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:10:59.288 17:59:08 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:10:59.288 17:59:08 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:10:59.288 17:59:08 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:10:59.288 17:59:08 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:10:59.288 17:59:08 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:10:59.288 17:59:08 -- common/autotest_common.sh@720 -- # xtrace_disable 00:10:59.288 17:59:08 -- common/autotest_common.sh@10 -- # set +x 00:10:59.288 17:59:08 -- nvmf/common.sh@470 -- # nvmfpid=903465 00:10:59.288 17:59:08 -- nvmf/common.sh@471 -- # waitforlisten 903465 00:10:59.288 17:59:08 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:10:59.288 17:59:08 -- common/autotest_common.sh@827 -- # '[' -z 903465 ']' 00:10:59.288 17:59:08 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:10:59.288 17:59:08 -- common/autotest_common.sh@832 -- # local max_retries=100 00:10:59.288 17:59:08 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:10:59.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:10:59.288 17:59:08 -- common/autotest_common.sh@836 -- # xtrace_disable 00:10:59.288 17:59:08 -- common/autotest_common.sh@10 -- # set +x 00:10:59.288 [2024-04-26 17:59:08.320419] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:10:59.288 [2024-04-26 17:59:08.320475] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:10:59.288 EAL: No free 2048 kB hugepages reported on node 1 00:10:59.288 [2024-04-26 17:59:08.394262] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:10:59.288 [2024-04-26 17:59:08.472372] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:10:59.288 [2024-04-26 17:59:08.472417] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:10:59.288 [2024-04-26 17:59:08.472427] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:10:59.288 [2024-04-26 17:59:08.472436] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:10:59.288 [2024-04-26 17:59:08.472444] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:10:59.288 [2024-04-26 17:59:08.472464] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:00.224 17:59:09 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:11:00.224 17:59:09 -- common/autotest_common.sh@860 -- # return 0 00:11:00.224 17:59:09 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:00.224 17:59:09 -- common/autotest_common.sh@726 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 17:59:09 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:00.224 17:59:09 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 [2024-04-26 17:59:09.194734] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x24f86e0/0x24fcbd0) succeed. 00:11:00.224 [2024-04-26 17:59:09.204445] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x24f9be0/0x253e260) succeed. 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 [2024-04-26 17:59:09.258054] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 NULL1 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:11:00.224 17:59:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:00.224 17:59:09 -- common/autotest_common.sh@10 -- # set +x 00:11:00.224 17:59:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:00.224 17:59:09 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:11:00.224 [2024-04-26 17:59:09.313638] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:11:00.224 [2024-04-26 17:59:09.313675] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid903645 ] 00:11:00.224 EAL: No free 2048 kB hugepages reported on node 1 00:11:00.484 Attached to nqn.2016-06.io.spdk:cnode1 00:11:00.484 Namespace ID: 1 size: 1GB 00:11:00.484 fused_ordering(0) 00:11:00.484 fused_ordering(1) 00:11:00.484 fused_ordering(2) 00:11:00.484 fused_ordering(3) 00:11:00.484 fused_ordering(4) 00:11:00.484 fused_ordering(5) 00:11:00.484 fused_ordering(6) 00:11:00.484 fused_ordering(7) 00:11:00.484 fused_ordering(8) 00:11:00.484 fused_ordering(9) 00:11:00.484 fused_ordering(10) 00:11:00.484 fused_ordering(11) 00:11:00.484 fused_ordering(12) 00:11:00.484 fused_ordering(13) 00:11:00.484 fused_ordering(14) 00:11:00.484 fused_ordering(15) 00:11:00.484 fused_ordering(16) 00:11:00.484 fused_ordering(17) 00:11:00.484 fused_ordering(18) 00:11:00.484 fused_ordering(19) 00:11:00.484 fused_ordering(20) 00:11:00.484 fused_ordering(21) 00:11:00.484 fused_ordering(22) 00:11:00.484 fused_ordering(23) 00:11:00.484 fused_ordering(24) 00:11:00.484 fused_ordering(25) 00:11:00.484 fused_ordering(26) 00:11:00.484 fused_ordering(27) 00:11:00.484 fused_ordering(28) 00:11:00.484 fused_ordering(29) 00:11:00.484 fused_ordering(30) 00:11:00.484 fused_ordering(31) 00:11:00.484 fused_ordering(32) 00:11:00.484 fused_ordering(33) 00:11:00.484 fused_ordering(34) 00:11:00.484 fused_ordering(35) 00:11:00.484 fused_ordering(36) 00:11:00.484 fused_ordering(37) 00:11:00.484 fused_ordering(38) 00:11:00.484 fused_ordering(39) 00:11:00.484 fused_ordering(40) 00:11:00.484 fused_ordering(41) 00:11:00.484 fused_ordering(42) 00:11:00.484 fused_ordering(43) 00:11:00.484 fused_ordering(44) 00:11:00.484 fused_ordering(45) 00:11:00.484 fused_ordering(46) 00:11:00.484 fused_ordering(47) 00:11:00.484 fused_ordering(48) 00:11:00.484 fused_ordering(49) 00:11:00.484 fused_ordering(50) 00:11:00.484 fused_ordering(51) 00:11:00.484 fused_ordering(52) 00:11:00.484 fused_ordering(53) 00:11:00.484 fused_ordering(54) 00:11:00.484 fused_ordering(55) 00:11:00.484 fused_ordering(56) 00:11:00.484 fused_ordering(57) 00:11:00.484 fused_ordering(58) 00:11:00.484 fused_ordering(59) 00:11:00.484 fused_ordering(60) 00:11:00.484 fused_ordering(61) 00:11:00.484 fused_ordering(62) 00:11:00.484 fused_ordering(63) 00:11:00.484 fused_ordering(64) 00:11:00.484 fused_ordering(65) 00:11:00.484 fused_ordering(66) 00:11:00.484 fused_ordering(67) 00:11:00.484 fused_ordering(68) 00:11:00.484 fused_ordering(69) 00:11:00.484 fused_ordering(70) 00:11:00.484 fused_ordering(71) 00:11:00.484 fused_ordering(72) 00:11:00.484 fused_ordering(73) 00:11:00.484 fused_ordering(74) 00:11:00.484 fused_ordering(75) 00:11:00.484 fused_ordering(76) 00:11:00.484 fused_ordering(77) 00:11:00.484 fused_ordering(78) 00:11:00.484 fused_ordering(79) 00:11:00.484 fused_ordering(80) 00:11:00.484 fused_ordering(81) 00:11:00.484 fused_ordering(82) 00:11:00.484 fused_ordering(83) 00:11:00.484 fused_ordering(84) 00:11:00.484 fused_ordering(85) 00:11:00.484 fused_ordering(86) 00:11:00.484 fused_ordering(87) 00:11:00.484 fused_ordering(88) 00:11:00.484 fused_ordering(89) 00:11:00.484 fused_ordering(90) 00:11:00.484 fused_ordering(91) 00:11:00.484 fused_ordering(92) 00:11:00.484 fused_ordering(93) 00:11:00.484 fused_ordering(94) 00:11:00.484 fused_ordering(95) 00:11:00.484 fused_ordering(96) 00:11:00.484 fused_ordering(97) 00:11:00.484 fused_ordering(98) 00:11:00.484 fused_ordering(99) 00:11:00.484 fused_ordering(100) 00:11:00.484 fused_ordering(101) 00:11:00.484 fused_ordering(102) 00:11:00.484 fused_ordering(103) 00:11:00.484 fused_ordering(104) 00:11:00.484 fused_ordering(105) 00:11:00.484 fused_ordering(106) 00:11:00.484 fused_ordering(107) 00:11:00.484 fused_ordering(108) 00:11:00.484 fused_ordering(109) 00:11:00.484 fused_ordering(110) 00:11:00.484 fused_ordering(111) 00:11:00.484 fused_ordering(112) 00:11:00.484 fused_ordering(113) 00:11:00.484 fused_ordering(114) 00:11:00.484 fused_ordering(115) 00:11:00.484 fused_ordering(116) 00:11:00.484 fused_ordering(117) 00:11:00.484 fused_ordering(118) 00:11:00.484 fused_ordering(119) 00:11:00.484 fused_ordering(120) 00:11:00.484 fused_ordering(121) 00:11:00.484 fused_ordering(122) 00:11:00.484 fused_ordering(123) 00:11:00.484 fused_ordering(124) 00:11:00.484 fused_ordering(125) 00:11:00.484 fused_ordering(126) 00:11:00.484 fused_ordering(127) 00:11:00.484 fused_ordering(128) 00:11:00.484 fused_ordering(129) 00:11:00.484 fused_ordering(130) 00:11:00.484 fused_ordering(131) 00:11:00.484 fused_ordering(132) 00:11:00.484 fused_ordering(133) 00:11:00.484 fused_ordering(134) 00:11:00.484 fused_ordering(135) 00:11:00.484 fused_ordering(136) 00:11:00.484 fused_ordering(137) 00:11:00.484 fused_ordering(138) 00:11:00.484 fused_ordering(139) 00:11:00.484 fused_ordering(140) 00:11:00.484 fused_ordering(141) 00:11:00.484 fused_ordering(142) 00:11:00.484 fused_ordering(143) 00:11:00.484 fused_ordering(144) 00:11:00.484 fused_ordering(145) 00:11:00.484 fused_ordering(146) 00:11:00.484 fused_ordering(147) 00:11:00.484 fused_ordering(148) 00:11:00.484 fused_ordering(149) 00:11:00.484 fused_ordering(150) 00:11:00.484 fused_ordering(151) 00:11:00.484 fused_ordering(152) 00:11:00.484 fused_ordering(153) 00:11:00.484 fused_ordering(154) 00:11:00.484 fused_ordering(155) 00:11:00.484 fused_ordering(156) 00:11:00.484 fused_ordering(157) 00:11:00.484 fused_ordering(158) 00:11:00.484 fused_ordering(159) 00:11:00.484 fused_ordering(160) 00:11:00.484 fused_ordering(161) 00:11:00.484 fused_ordering(162) 00:11:00.484 fused_ordering(163) 00:11:00.484 fused_ordering(164) 00:11:00.484 fused_ordering(165) 00:11:00.484 fused_ordering(166) 00:11:00.484 fused_ordering(167) 00:11:00.484 fused_ordering(168) 00:11:00.484 fused_ordering(169) 00:11:00.484 fused_ordering(170) 00:11:00.484 fused_ordering(171) 00:11:00.484 fused_ordering(172) 00:11:00.484 fused_ordering(173) 00:11:00.484 fused_ordering(174) 00:11:00.484 fused_ordering(175) 00:11:00.484 fused_ordering(176) 00:11:00.484 fused_ordering(177) 00:11:00.484 fused_ordering(178) 00:11:00.484 fused_ordering(179) 00:11:00.484 fused_ordering(180) 00:11:00.484 fused_ordering(181) 00:11:00.484 fused_ordering(182) 00:11:00.484 fused_ordering(183) 00:11:00.484 fused_ordering(184) 00:11:00.484 fused_ordering(185) 00:11:00.484 fused_ordering(186) 00:11:00.484 fused_ordering(187) 00:11:00.484 fused_ordering(188) 00:11:00.484 fused_ordering(189) 00:11:00.484 fused_ordering(190) 00:11:00.484 fused_ordering(191) 00:11:00.484 fused_ordering(192) 00:11:00.484 fused_ordering(193) 00:11:00.484 fused_ordering(194) 00:11:00.484 fused_ordering(195) 00:11:00.484 fused_ordering(196) 00:11:00.485 fused_ordering(197) 00:11:00.485 fused_ordering(198) 00:11:00.485 fused_ordering(199) 00:11:00.485 fused_ordering(200) 00:11:00.485 fused_ordering(201) 00:11:00.485 fused_ordering(202) 00:11:00.485 fused_ordering(203) 00:11:00.485 fused_ordering(204) 00:11:00.485 fused_ordering(205) 00:11:00.485 fused_ordering(206) 00:11:00.485 fused_ordering(207) 00:11:00.485 fused_ordering(208) 00:11:00.485 fused_ordering(209) 00:11:00.485 fused_ordering(210) 00:11:00.485 fused_ordering(211) 00:11:00.485 fused_ordering(212) 00:11:00.485 fused_ordering(213) 00:11:00.485 fused_ordering(214) 00:11:00.485 fused_ordering(215) 00:11:00.485 fused_ordering(216) 00:11:00.485 fused_ordering(217) 00:11:00.485 fused_ordering(218) 00:11:00.485 fused_ordering(219) 00:11:00.485 fused_ordering(220) 00:11:00.485 fused_ordering(221) 00:11:00.485 fused_ordering(222) 00:11:00.485 fused_ordering(223) 00:11:00.485 fused_ordering(224) 00:11:00.485 fused_ordering(225) 00:11:00.485 fused_ordering(226) 00:11:00.485 fused_ordering(227) 00:11:00.485 fused_ordering(228) 00:11:00.485 fused_ordering(229) 00:11:00.485 fused_ordering(230) 00:11:00.485 fused_ordering(231) 00:11:00.485 fused_ordering(232) 00:11:00.485 fused_ordering(233) 00:11:00.485 fused_ordering(234) 00:11:00.485 fused_ordering(235) 00:11:00.485 fused_ordering(236) 00:11:00.485 fused_ordering(237) 00:11:00.485 fused_ordering(238) 00:11:00.485 fused_ordering(239) 00:11:00.485 fused_ordering(240) 00:11:00.485 fused_ordering(241) 00:11:00.485 fused_ordering(242) 00:11:00.485 fused_ordering(243) 00:11:00.485 fused_ordering(244) 00:11:00.485 fused_ordering(245) 00:11:00.485 fused_ordering(246) 00:11:00.485 fused_ordering(247) 00:11:00.485 fused_ordering(248) 00:11:00.485 fused_ordering(249) 00:11:00.485 fused_ordering(250) 00:11:00.485 fused_ordering(251) 00:11:00.485 fused_ordering(252) 00:11:00.485 fused_ordering(253) 00:11:00.485 fused_ordering(254) 00:11:00.485 fused_ordering(255) 00:11:00.485 fused_ordering(256) 00:11:00.485 fused_ordering(257) 00:11:00.485 fused_ordering(258) 00:11:00.485 fused_ordering(259) 00:11:00.485 fused_ordering(260) 00:11:00.485 fused_ordering(261) 00:11:00.485 fused_ordering(262) 00:11:00.485 fused_ordering(263) 00:11:00.485 fused_ordering(264) 00:11:00.485 fused_ordering(265) 00:11:00.485 fused_ordering(266) 00:11:00.485 fused_ordering(267) 00:11:00.485 fused_ordering(268) 00:11:00.485 fused_ordering(269) 00:11:00.485 fused_ordering(270) 00:11:00.485 fused_ordering(271) 00:11:00.485 fused_ordering(272) 00:11:00.485 fused_ordering(273) 00:11:00.485 fused_ordering(274) 00:11:00.485 fused_ordering(275) 00:11:00.485 fused_ordering(276) 00:11:00.485 fused_ordering(277) 00:11:00.485 fused_ordering(278) 00:11:00.485 fused_ordering(279) 00:11:00.485 fused_ordering(280) 00:11:00.485 fused_ordering(281) 00:11:00.485 fused_ordering(282) 00:11:00.485 fused_ordering(283) 00:11:00.485 fused_ordering(284) 00:11:00.485 fused_ordering(285) 00:11:00.485 fused_ordering(286) 00:11:00.485 fused_ordering(287) 00:11:00.485 fused_ordering(288) 00:11:00.485 fused_ordering(289) 00:11:00.485 fused_ordering(290) 00:11:00.485 fused_ordering(291) 00:11:00.485 fused_ordering(292) 00:11:00.485 fused_ordering(293) 00:11:00.485 fused_ordering(294) 00:11:00.485 fused_ordering(295) 00:11:00.485 fused_ordering(296) 00:11:00.485 fused_ordering(297) 00:11:00.485 fused_ordering(298) 00:11:00.485 fused_ordering(299) 00:11:00.485 fused_ordering(300) 00:11:00.485 fused_ordering(301) 00:11:00.485 fused_ordering(302) 00:11:00.485 fused_ordering(303) 00:11:00.485 fused_ordering(304) 00:11:00.485 fused_ordering(305) 00:11:00.485 fused_ordering(306) 00:11:00.485 fused_ordering(307) 00:11:00.485 fused_ordering(308) 00:11:00.485 fused_ordering(309) 00:11:00.485 fused_ordering(310) 00:11:00.485 fused_ordering(311) 00:11:00.485 fused_ordering(312) 00:11:00.485 fused_ordering(313) 00:11:00.485 fused_ordering(314) 00:11:00.485 fused_ordering(315) 00:11:00.485 fused_ordering(316) 00:11:00.485 fused_ordering(317) 00:11:00.485 fused_ordering(318) 00:11:00.485 fused_ordering(319) 00:11:00.485 fused_ordering(320) 00:11:00.485 fused_ordering(321) 00:11:00.485 fused_ordering(322) 00:11:00.485 fused_ordering(323) 00:11:00.485 fused_ordering(324) 00:11:00.485 fused_ordering(325) 00:11:00.485 fused_ordering(326) 00:11:00.485 fused_ordering(327) 00:11:00.485 fused_ordering(328) 00:11:00.485 fused_ordering(329) 00:11:00.485 fused_ordering(330) 00:11:00.485 fused_ordering(331) 00:11:00.485 fused_ordering(332) 00:11:00.485 fused_ordering(333) 00:11:00.485 fused_ordering(334) 00:11:00.485 fused_ordering(335) 00:11:00.485 fused_ordering(336) 00:11:00.485 fused_ordering(337) 00:11:00.485 fused_ordering(338) 00:11:00.485 fused_ordering(339) 00:11:00.485 fused_ordering(340) 00:11:00.485 fused_ordering(341) 00:11:00.485 fused_ordering(342) 00:11:00.485 fused_ordering(343) 00:11:00.485 fused_ordering(344) 00:11:00.485 fused_ordering(345) 00:11:00.485 fused_ordering(346) 00:11:00.485 fused_ordering(347) 00:11:00.485 fused_ordering(348) 00:11:00.485 fused_ordering(349) 00:11:00.485 fused_ordering(350) 00:11:00.485 fused_ordering(351) 00:11:00.485 fused_ordering(352) 00:11:00.485 fused_ordering(353) 00:11:00.485 fused_ordering(354) 00:11:00.485 fused_ordering(355) 00:11:00.485 fused_ordering(356) 00:11:00.485 fused_ordering(357) 00:11:00.485 fused_ordering(358) 00:11:00.485 fused_ordering(359) 00:11:00.485 fused_ordering(360) 00:11:00.485 fused_ordering(361) 00:11:00.485 fused_ordering(362) 00:11:00.485 fused_ordering(363) 00:11:00.485 fused_ordering(364) 00:11:00.485 fused_ordering(365) 00:11:00.485 fused_ordering(366) 00:11:00.485 fused_ordering(367) 00:11:00.485 fused_ordering(368) 00:11:00.485 fused_ordering(369) 00:11:00.485 fused_ordering(370) 00:11:00.485 fused_ordering(371) 00:11:00.485 fused_ordering(372) 00:11:00.485 fused_ordering(373) 00:11:00.485 fused_ordering(374) 00:11:00.485 fused_ordering(375) 00:11:00.485 fused_ordering(376) 00:11:00.485 fused_ordering(377) 00:11:00.485 fused_ordering(378) 00:11:00.485 fused_ordering(379) 00:11:00.485 fused_ordering(380) 00:11:00.485 fused_ordering(381) 00:11:00.485 fused_ordering(382) 00:11:00.485 fused_ordering(383) 00:11:00.485 fused_ordering(384) 00:11:00.485 fused_ordering(385) 00:11:00.485 fused_ordering(386) 00:11:00.485 fused_ordering(387) 00:11:00.485 fused_ordering(388) 00:11:00.485 fused_ordering(389) 00:11:00.485 fused_ordering(390) 00:11:00.485 fused_ordering(391) 00:11:00.485 fused_ordering(392) 00:11:00.485 fused_ordering(393) 00:11:00.485 fused_ordering(394) 00:11:00.485 fused_ordering(395) 00:11:00.485 fused_ordering(396) 00:11:00.485 fused_ordering(397) 00:11:00.485 fused_ordering(398) 00:11:00.485 fused_ordering(399) 00:11:00.485 fused_ordering(400) 00:11:00.485 fused_ordering(401) 00:11:00.485 fused_ordering(402) 00:11:00.485 fused_ordering(403) 00:11:00.485 fused_ordering(404) 00:11:00.485 fused_ordering(405) 00:11:00.485 fused_ordering(406) 00:11:00.485 fused_ordering(407) 00:11:00.485 fused_ordering(408) 00:11:00.485 fused_ordering(409) 00:11:00.485 fused_ordering(410) 00:11:00.485 fused_ordering(411) 00:11:00.485 fused_ordering(412) 00:11:00.485 fused_ordering(413) 00:11:00.485 fused_ordering(414) 00:11:00.485 fused_ordering(415) 00:11:00.485 fused_ordering(416) 00:11:00.485 fused_ordering(417) 00:11:00.485 fused_ordering(418) 00:11:00.485 fused_ordering(419) 00:11:00.485 fused_ordering(420) 00:11:00.485 fused_ordering(421) 00:11:00.485 fused_ordering(422) 00:11:00.485 fused_ordering(423) 00:11:00.485 fused_ordering(424) 00:11:00.485 fused_ordering(425) 00:11:00.485 fused_ordering(426) 00:11:00.485 fused_ordering(427) 00:11:00.485 fused_ordering(428) 00:11:00.485 fused_ordering(429) 00:11:00.485 fused_ordering(430) 00:11:00.485 fused_ordering(431) 00:11:00.485 fused_ordering(432) 00:11:00.485 fused_ordering(433) 00:11:00.485 fused_ordering(434) 00:11:00.485 fused_ordering(435) 00:11:00.485 fused_ordering(436) 00:11:00.485 fused_ordering(437) 00:11:00.485 fused_ordering(438) 00:11:00.485 fused_ordering(439) 00:11:00.485 fused_ordering(440) 00:11:00.485 fused_ordering(441) 00:11:00.485 fused_ordering(442) 00:11:00.485 fused_ordering(443) 00:11:00.485 fused_ordering(444) 00:11:00.485 fused_ordering(445) 00:11:00.485 fused_ordering(446) 00:11:00.485 fused_ordering(447) 00:11:00.485 fused_ordering(448) 00:11:00.485 fused_ordering(449) 00:11:00.485 fused_ordering(450) 00:11:00.485 fused_ordering(451) 00:11:00.485 fused_ordering(452) 00:11:00.485 fused_ordering(453) 00:11:00.485 fused_ordering(454) 00:11:00.485 fused_ordering(455) 00:11:00.485 fused_ordering(456) 00:11:00.485 fused_ordering(457) 00:11:00.485 fused_ordering(458) 00:11:00.485 fused_ordering(459) 00:11:00.485 fused_ordering(460) 00:11:00.485 fused_ordering(461) 00:11:00.485 fused_ordering(462) 00:11:00.485 fused_ordering(463) 00:11:00.485 fused_ordering(464) 00:11:00.485 fused_ordering(465) 00:11:00.485 fused_ordering(466) 00:11:00.485 fused_ordering(467) 00:11:00.485 fused_ordering(468) 00:11:00.485 fused_ordering(469) 00:11:00.485 fused_ordering(470) 00:11:00.485 fused_ordering(471) 00:11:00.486 fused_ordering(472) 00:11:00.486 fused_ordering(473) 00:11:00.486 fused_ordering(474) 00:11:00.486 fused_ordering(475) 00:11:00.486 fused_ordering(476) 00:11:00.486 fused_ordering(477) 00:11:00.486 fused_ordering(478) 00:11:00.486 fused_ordering(479) 00:11:00.486 fused_ordering(480) 00:11:00.486 fused_ordering(481) 00:11:00.486 fused_ordering(482) 00:11:00.486 fused_ordering(483) 00:11:00.486 fused_ordering(484) 00:11:00.486 fused_ordering(485) 00:11:00.486 fused_ordering(486) 00:11:00.486 fused_ordering(487) 00:11:00.486 fused_ordering(488) 00:11:00.486 fused_ordering(489) 00:11:00.486 fused_ordering(490) 00:11:00.486 fused_ordering(491) 00:11:00.486 fused_ordering(492) 00:11:00.486 fused_ordering(493) 00:11:00.486 fused_ordering(494) 00:11:00.486 fused_ordering(495) 00:11:00.486 fused_ordering(496) 00:11:00.486 fused_ordering(497) 00:11:00.486 fused_ordering(498) 00:11:00.486 fused_ordering(499) 00:11:00.486 fused_ordering(500) 00:11:00.486 fused_ordering(501) 00:11:00.486 fused_ordering(502) 00:11:00.486 fused_ordering(503) 00:11:00.486 fused_ordering(504) 00:11:00.486 fused_ordering(505) 00:11:00.486 fused_ordering(506) 00:11:00.486 fused_ordering(507) 00:11:00.486 fused_ordering(508) 00:11:00.486 fused_ordering(509) 00:11:00.486 fused_ordering(510) 00:11:00.486 fused_ordering(511) 00:11:00.486 fused_ordering(512) 00:11:00.486 fused_ordering(513) 00:11:00.486 fused_ordering(514) 00:11:00.486 fused_ordering(515) 00:11:00.486 fused_ordering(516) 00:11:00.486 fused_ordering(517) 00:11:00.486 fused_ordering(518) 00:11:00.486 fused_ordering(519) 00:11:00.486 fused_ordering(520) 00:11:00.486 fused_ordering(521) 00:11:00.486 fused_ordering(522) 00:11:00.486 fused_ordering(523) 00:11:00.486 fused_ordering(524) 00:11:00.486 fused_ordering(525) 00:11:00.486 fused_ordering(526) 00:11:00.486 fused_ordering(527) 00:11:00.486 fused_ordering(528) 00:11:00.486 fused_ordering(529) 00:11:00.486 fused_ordering(530) 00:11:00.486 fused_ordering(531) 00:11:00.486 fused_ordering(532) 00:11:00.486 fused_ordering(533) 00:11:00.486 fused_ordering(534) 00:11:00.486 fused_ordering(535) 00:11:00.486 fused_ordering(536) 00:11:00.486 fused_ordering(537) 00:11:00.486 fused_ordering(538) 00:11:00.486 fused_ordering(539) 00:11:00.486 fused_ordering(540) 00:11:00.486 fused_ordering(541) 00:11:00.486 fused_ordering(542) 00:11:00.486 fused_ordering(543) 00:11:00.486 fused_ordering(544) 00:11:00.486 fused_ordering(545) 00:11:00.486 fused_ordering(546) 00:11:00.486 fused_ordering(547) 00:11:00.486 fused_ordering(548) 00:11:00.486 fused_ordering(549) 00:11:00.486 fused_ordering(550) 00:11:00.486 fused_ordering(551) 00:11:00.486 fused_ordering(552) 00:11:00.486 fused_ordering(553) 00:11:00.486 fused_ordering(554) 00:11:00.486 fused_ordering(555) 00:11:00.486 fused_ordering(556) 00:11:00.486 fused_ordering(557) 00:11:00.486 fused_ordering(558) 00:11:00.486 fused_ordering(559) 00:11:00.486 fused_ordering(560) 00:11:00.486 fused_ordering(561) 00:11:00.486 fused_ordering(562) 00:11:00.486 fused_ordering(563) 00:11:00.486 fused_ordering(564) 00:11:00.486 fused_ordering(565) 00:11:00.486 fused_ordering(566) 00:11:00.486 fused_ordering(567) 00:11:00.486 fused_ordering(568) 00:11:00.486 fused_ordering(569) 00:11:00.486 fused_ordering(570) 00:11:00.486 fused_ordering(571) 00:11:00.486 fused_ordering(572) 00:11:00.486 fused_ordering(573) 00:11:00.486 fused_ordering(574) 00:11:00.486 fused_ordering(575) 00:11:00.486 fused_ordering(576) 00:11:00.486 fused_ordering(577) 00:11:00.486 fused_ordering(578) 00:11:00.486 fused_ordering(579) 00:11:00.486 fused_ordering(580) 00:11:00.486 fused_ordering(581) 00:11:00.486 fused_ordering(582) 00:11:00.486 fused_ordering(583) 00:11:00.486 fused_ordering(584) 00:11:00.486 fused_ordering(585) 00:11:00.486 fused_ordering(586) 00:11:00.486 fused_ordering(587) 00:11:00.486 fused_ordering(588) 00:11:00.486 fused_ordering(589) 00:11:00.486 fused_ordering(590) 00:11:00.486 fused_ordering(591) 00:11:00.486 fused_ordering(592) 00:11:00.486 fused_ordering(593) 00:11:00.486 fused_ordering(594) 00:11:00.486 fused_ordering(595) 00:11:00.486 fused_ordering(596) 00:11:00.486 fused_ordering(597) 00:11:00.486 fused_ordering(598) 00:11:00.486 fused_ordering(599) 00:11:00.486 fused_ordering(600) 00:11:00.486 fused_ordering(601) 00:11:00.486 fused_ordering(602) 00:11:00.486 fused_ordering(603) 00:11:00.486 fused_ordering(604) 00:11:00.486 fused_ordering(605) 00:11:00.486 fused_ordering(606) 00:11:00.486 fused_ordering(607) 00:11:00.486 fused_ordering(608) 00:11:00.486 fused_ordering(609) 00:11:00.486 fused_ordering(610) 00:11:00.486 fused_ordering(611) 00:11:00.486 fused_ordering(612) 00:11:00.486 fused_ordering(613) 00:11:00.486 fused_ordering(614) 00:11:00.486 fused_ordering(615) 00:11:00.745 fused_ordering(616) 00:11:00.745 fused_ordering(617) 00:11:00.745 fused_ordering(618) 00:11:00.745 fused_ordering(619) 00:11:00.745 fused_ordering(620) 00:11:00.745 fused_ordering(621) 00:11:00.745 fused_ordering(622) 00:11:00.745 fused_ordering(623) 00:11:00.745 fused_ordering(624) 00:11:00.745 fused_ordering(625) 00:11:00.745 fused_ordering(626) 00:11:00.745 fused_ordering(627) 00:11:00.745 fused_ordering(628) 00:11:00.745 fused_ordering(629) 00:11:00.745 fused_ordering(630) 00:11:00.745 fused_ordering(631) 00:11:00.745 fused_ordering(632) 00:11:00.745 fused_ordering(633) 00:11:00.745 fused_ordering(634) 00:11:00.745 fused_ordering(635) 00:11:00.745 fused_ordering(636) 00:11:00.745 fused_ordering(637) 00:11:00.745 fused_ordering(638) 00:11:00.745 fused_ordering(639) 00:11:00.745 fused_ordering(640) 00:11:00.745 fused_ordering(641) 00:11:00.745 fused_ordering(642) 00:11:00.745 fused_ordering(643) 00:11:00.745 fused_ordering(644) 00:11:00.745 fused_ordering(645) 00:11:00.745 fused_ordering(646) 00:11:00.745 fused_ordering(647) 00:11:00.745 fused_ordering(648) 00:11:00.745 fused_ordering(649) 00:11:00.745 fused_ordering(650) 00:11:00.745 fused_ordering(651) 00:11:00.745 fused_ordering(652) 00:11:00.745 fused_ordering(653) 00:11:00.745 fused_ordering(654) 00:11:00.745 fused_ordering(655) 00:11:00.745 fused_ordering(656) 00:11:00.745 fused_ordering(657) 00:11:00.745 fused_ordering(658) 00:11:00.745 fused_ordering(659) 00:11:00.745 fused_ordering(660) 00:11:00.745 fused_ordering(661) 00:11:00.745 fused_ordering(662) 00:11:00.745 fused_ordering(663) 00:11:00.745 fused_ordering(664) 00:11:00.745 fused_ordering(665) 00:11:00.745 fused_ordering(666) 00:11:00.745 fused_ordering(667) 00:11:00.745 fused_ordering(668) 00:11:00.745 fused_ordering(669) 00:11:00.745 fused_ordering(670) 00:11:00.745 fused_ordering(671) 00:11:00.745 fused_ordering(672) 00:11:00.745 fused_ordering(673) 00:11:00.745 fused_ordering(674) 00:11:00.745 fused_ordering(675) 00:11:00.745 fused_ordering(676) 00:11:00.745 fused_ordering(677) 00:11:00.745 fused_ordering(678) 00:11:00.745 fused_ordering(679) 00:11:00.745 fused_ordering(680) 00:11:00.745 fused_ordering(681) 00:11:00.745 fused_ordering(682) 00:11:00.745 fused_ordering(683) 00:11:00.745 fused_ordering(684) 00:11:00.745 fused_ordering(685) 00:11:00.745 fused_ordering(686) 00:11:00.745 fused_ordering(687) 00:11:00.745 fused_ordering(688) 00:11:00.745 fused_ordering(689) 00:11:00.745 fused_ordering(690) 00:11:00.745 fused_ordering(691) 00:11:00.745 fused_ordering(692) 00:11:00.745 fused_ordering(693) 00:11:00.745 fused_ordering(694) 00:11:00.745 fused_ordering(695) 00:11:00.745 fused_ordering(696) 00:11:00.745 fused_ordering(697) 00:11:00.745 fused_ordering(698) 00:11:00.745 fused_ordering(699) 00:11:00.745 fused_ordering(700) 00:11:00.745 fused_ordering(701) 00:11:00.745 fused_ordering(702) 00:11:00.745 fused_ordering(703) 00:11:00.745 fused_ordering(704) 00:11:00.745 fused_ordering(705) 00:11:00.745 fused_ordering(706) 00:11:00.745 fused_ordering(707) 00:11:00.745 fused_ordering(708) 00:11:00.745 fused_ordering(709) 00:11:00.745 fused_ordering(710) 00:11:00.745 fused_ordering(711) 00:11:00.745 fused_ordering(712) 00:11:00.745 fused_ordering(713) 00:11:00.745 fused_ordering(714) 00:11:00.745 fused_ordering(715) 00:11:00.745 fused_ordering(716) 00:11:00.745 fused_ordering(717) 00:11:00.745 fused_ordering(718) 00:11:00.745 fused_ordering(719) 00:11:00.745 fused_ordering(720) 00:11:00.745 fused_ordering(721) 00:11:00.745 fused_ordering(722) 00:11:00.745 fused_ordering(723) 00:11:00.745 fused_ordering(724) 00:11:00.745 fused_ordering(725) 00:11:00.746 fused_ordering(726) 00:11:00.746 fused_ordering(727) 00:11:00.746 fused_ordering(728) 00:11:00.746 fused_ordering(729) 00:11:00.746 fused_ordering(730) 00:11:00.746 fused_ordering(731) 00:11:00.746 fused_ordering(732) 00:11:00.746 fused_ordering(733) 00:11:00.746 fused_ordering(734) 00:11:00.746 fused_ordering(735) 00:11:00.746 fused_ordering(736) 00:11:00.746 fused_ordering(737) 00:11:00.746 fused_ordering(738) 00:11:00.746 fused_ordering(739) 00:11:00.746 fused_ordering(740) 00:11:00.746 fused_ordering(741) 00:11:00.746 fused_ordering(742) 00:11:00.746 fused_ordering(743) 00:11:00.746 fused_ordering(744) 00:11:00.746 fused_ordering(745) 00:11:00.746 fused_ordering(746) 00:11:00.746 fused_ordering(747) 00:11:00.746 fused_ordering(748) 00:11:00.746 fused_ordering(749) 00:11:00.746 fused_ordering(750) 00:11:00.746 fused_ordering(751) 00:11:00.746 fused_ordering(752) 00:11:00.746 fused_ordering(753) 00:11:00.746 fused_ordering(754) 00:11:00.746 fused_ordering(755) 00:11:00.746 fused_ordering(756) 00:11:00.746 fused_ordering(757) 00:11:00.746 fused_ordering(758) 00:11:00.746 fused_ordering(759) 00:11:00.746 fused_ordering(760) 00:11:00.746 fused_ordering(761) 00:11:00.746 fused_ordering(762) 00:11:00.746 fused_ordering(763) 00:11:00.746 fused_ordering(764) 00:11:00.746 fused_ordering(765) 00:11:00.746 fused_ordering(766) 00:11:00.746 fused_ordering(767) 00:11:00.746 fused_ordering(768) 00:11:00.746 fused_ordering(769) 00:11:00.746 fused_ordering(770) 00:11:00.746 fused_ordering(771) 00:11:00.746 fused_ordering(772) 00:11:00.746 fused_ordering(773) 00:11:00.746 fused_ordering(774) 00:11:00.746 fused_ordering(775) 00:11:00.746 fused_ordering(776) 00:11:00.746 fused_ordering(777) 00:11:00.746 fused_ordering(778) 00:11:00.746 fused_ordering(779) 00:11:00.746 fused_ordering(780) 00:11:00.746 fused_ordering(781) 00:11:00.746 fused_ordering(782) 00:11:00.746 fused_ordering(783) 00:11:00.746 fused_ordering(784) 00:11:00.746 fused_ordering(785) 00:11:00.746 fused_ordering(786) 00:11:00.746 fused_ordering(787) 00:11:00.746 fused_ordering(788) 00:11:00.746 fused_ordering(789) 00:11:00.746 fused_ordering(790) 00:11:00.746 fused_ordering(791) 00:11:00.746 fused_ordering(792) 00:11:00.746 fused_ordering(793) 00:11:00.746 fused_ordering(794) 00:11:00.746 fused_ordering(795) 00:11:00.746 fused_ordering(796) 00:11:00.746 fused_ordering(797) 00:11:00.746 fused_ordering(798) 00:11:00.746 fused_ordering(799) 00:11:00.746 fused_ordering(800) 00:11:00.746 fused_ordering(801) 00:11:00.746 fused_ordering(802) 00:11:00.746 fused_ordering(803) 00:11:00.746 fused_ordering(804) 00:11:00.746 fused_ordering(805) 00:11:00.746 fused_ordering(806) 00:11:00.746 fused_ordering(807) 00:11:00.746 fused_ordering(808) 00:11:00.746 fused_ordering(809) 00:11:00.746 fused_ordering(810) 00:11:00.746 fused_ordering(811) 00:11:00.746 fused_ordering(812) 00:11:00.746 fused_ordering(813) 00:11:00.746 fused_ordering(814) 00:11:00.746 fused_ordering(815) 00:11:00.746 fused_ordering(816) 00:11:00.746 fused_ordering(817) 00:11:00.746 fused_ordering(818) 00:11:00.746 fused_ordering(819) 00:11:00.746 fused_ordering(820) 00:11:01.005 fused_ordering(821) 00:11:01.005 fused_ordering(822) 00:11:01.005 fused_ordering(823) 00:11:01.005 fused_ordering(824) 00:11:01.005 fused_ordering(825) 00:11:01.005 fused_ordering(826) 00:11:01.005 fused_ordering(827) 00:11:01.005 fused_ordering(828) 00:11:01.005 fused_ordering(829) 00:11:01.005 fused_ordering(830) 00:11:01.005 fused_ordering(831) 00:11:01.005 fused_ordering(832) 00:11:01.005 fused_ordering(833) 00:11:01.005 fused_ordering(834) 00:11:01.005 fused_ordering(835) 00:11:01.005 fused_ordering(836) 00:11:01.005 fused_ordering(837) 00:11:01.005 fused_ordering(838) 00:11:01.005 fused_ordering(839) 00:11:01.005 fused_ordering(840) 00:11:01.005 fused_ordering(841) 00:11:01.005 fused_ordering(842) 00:11:01.005 fused_ordering(843) 00:11:01.005 fused_ordering(844) 00:11:01.005 fused_ordering(845) 00:11:01.005 fused_ordering(846) 00:11:01.005 fused_ordering(847) 00:11:01.005 fused_ordering(848) 00:11:01.005 fused_ordering(849) 00:11:01.005 fused_ordering(850) 00:11:01.005 fused_ordering(851) 00:11:01.005 fused_ordering(852) 00:11:01.005 fused_ordering(853) 00:11:01.005 fused_ordering(854) 00:11:01.005 fused_ordering(855) 00:11:01.005 fused_ordering(856) 00:11:01.005 fused_ordering(857) 00:11:01.005 fused_ordering(858) 00:11:01.005 fused_ordering(859) 00:11:01.005 fused_ordering(860) 00:11:01.005 fused_ordering(861) 00:11:01.005 fused_ordering(862) 00:11:01.005 fused_ordering(863) 00:11:01.005 fused_ordering(864) 00:11:01.005 fused_ordering(865) 00:11:01.005 fused_ordering(866) 00:11:01.005 fused_ordering(867) 00:11:01.005 fused_ordering(868) 00:11:01.005 fused_ordering(869) 00:11:01.005 fused_ordering(870) 00:11:01.005 fused_ordering(871) 00:11:01.005 fused_ordering(872) 00:11:01.005 fused_ordering(873) 00:11:01.005 fused_ordering(874) 00:11:01.005 fused_ordering(875) 00:11:01.005 fused_ordering(876) 00:11:01.005 fused_ordering(877) 00:11:01.005 fused_ordering(878) 00:11:01.005 fused_ordering(879) 00:11:01.005 fused_ordering(880) 00:11:01.005 fused_ordering(881) 00:11:01.006 fused_ordering(882) 00:11:01.006 fused_ordering(883) 00:11:01.006 fused_ordering(884) 00:11:01.006 fused_ordering(885) 00:11:01.006 fused_ordering(886) 00:11:01.006 fused_ordering(887) 00:11:01.006 fused_ordering(888) 00:11:01.006 fused_ordering(889) 00:11:01.006 fused_ordering(890) 00:11:01.006 fused_ordering(891) 00:11:01.006 fused_ordering(892) 00:11:01.006 fused_ordering(893) 00:11:01.006 fused_ordering(894) 00:11:01.006 fused_ordering(895) 00:11:01.006 fused_ordering(896) 00:11:01.006 fused_ordering(897) 00:11:01.006 fused_ordering(898) 00:11:01.006 fused_ordering(899) 00:11:01.006 fused_ordering(900) 00:11:01.006 fused_ordering(901) 00:11:01.006 fused_ordering(902) 00:11:01.006 fused_ordering(903) 00:11:01.006 fused_ordering(904) 00:11:01.006 fused_ordering(905) 00:11:01.006 fused_ordering(906) 00:11:01.006 fused_ordering(907) 00:11:01.006 fused_ordering(908) 00:11:01.006 fused_ordering(909) 00:11:01.006 fused_ordering(910) 00:11:01.006 fused_ordering(911) 00:11:01.006 fused_ordering(912) 00:11:01.006 fused_ordering(913) 00:11:01.006 fused_ordering(914) 00:11:01.006 fused_ordering(915) 00:11:01.006 fused_ordering(916) 00:11:01.006 fused_ordering(917) 00:11:01.006 fused_ordering(918) 00:11:01.006 fused_ordering(919) 00:11:01.006 fused_ordering(920) 00:11:01.006 fused_ordering(921) 00:11:01.006 fused_ordering(922) 00:11:01.006 fused_ordering(923) 00:11:01.006 fused_ordering(924) 00:11:01.006 fused_ordering(925) 00:11:01.006 fused_ordering(926) 00:11:01.006 fused_ordering(927) 00:11:01.006 fused_ordering(928) 00:11:01.006 fused_ordering(929) 00:11:01.006 fused_ordering(930) 00:11:01.006 fused_ordering(931) 00:11:01.006 fused_ordering(932) 00:11:01.006 fused_ordering(933) 00:11:01.006 fused_ordering(934) 00:11:01.006 fused_ordering(935) 00:11:01.006 fused_ordering(936) 00:11:01.006 fused_ordering(937) 00:11:01.006 fused_ordering(938) 00:11:01.006 fused_ordering(939) 00:11:01.006 fused_ordering(940) 00:11:01.006 fused_ordering(941) 00:11:01.006 fused_ordering(942) 00:11:01.006 fused_ordering(943) 00:11:01.006 fused_ordering(944) 00:11:01.006 fused_ordering(945) 00:11:01.006 fused_ordering(946) 00:11:01.006 fused_ordering(947) 00:11:01.006 fused_ordering(948) 00:11:01.006 fused_ordering(949) 00:11:01.006 fused_ordering(950) 00:11:01.006 fused_ordering(951) 00:11:01.006 fused_ordering(952) 00:11:01.006 fused_ordering(953) 00:11:01.006 fused_ordering(954) 00:11:01.006 fused_ordering(955) 00:11:01.006 fused_ordering(956) 00:11:01.006 fused_ordering(957) 00:11:01.006 fused_ordering(958) 00:11:01.006 fused_ordering(959) 00:11:01.006 fused_ordering(960) 00:11:01.006 fused_ordering(961) 00:11:01.006 fused_ordering(962) 00:11:01.006 fused_ordering(963) 00:11:01.006 fused_ordering(964) 00:11:01.006 fused_ordering(965) 00:11:01.006 fused_ordering(966) 00:11:01.006 fused_ordering(967) 00:11:01.006 fused_ordering(968) 00:11:01.006 fused_ordering(969) 00:11:01.006 fused_ordering(970) 00:11:01.006 fused_ordering(971) 00:11:01.006 fused_ordering(972) 00:11:01.006 fused_ordering(973) 00:11:01.006 fused_ordering(974) 00:11:01.006 fused_ordering(975) 00:11:01.006 fused_ordering(976) 00:11:01.006 fused_ordering(977) 00:11:01.006 fused_ordering(978) 00:11:01.006 fused_ordering(979) 00:11:01.006 fused_ordering(980) 00:11:01.006 fused_ordering(981) 00:11:01.006 fused_ordering(982) 00:11:01.006 fused_ordering(983) 00:11:01.006 fused_ordering(984) 00:11:01.006 fused_ordering(985) 00:11:01.006 fused_ordering(986) 00:11:01.006 fused_ordering(987) 00:11:01.006 fused_ordering(988) 00:11:01.006 fused_ordering(989) 00:11:01.006 fused_ordering(990) 00:11:01.006 fused_ordering(991) 00:11:01.006 fused_ordering(992) 00:11:01.006 fused_ordering(993) 00:11:01.006 fused_ordering(994) 00:11:01.006 fused_ordering(995) 00:11:01.006 fused_ordering(996) 00:11:01.006 fused_ordering(997) 00:11:01.006 fused_ordering(998) 00:11:01.006 fused_ordering(999) 00:11:01.006 fused_ordering(1000) 00:11:01.006 fused_ordering(1001) 00:11:01.006 fused_ordering(1002) 00:11:01.006 fused_ordering(1003) 00:11:01.006 fused_ordering(1004) 00:11:01.006 fused_ordering(1005) 00:11:01.006 fused_ordering(1006) 00:11:01.006 fused_ordering(1007) 00:11:01.006 fused_ordering(1008) 00:11:01.006 fused_ordering(1009) 00:11:01.006 fused_ordering(1010) 00:11:01.006 fused_ordering(1011) 00:11:01.006 fused_ordering(1012) 00:11:01.006 fused_ordering(1013) 00:11:01.006 fused_ordering(1014) 00:11:01.006 fused_ordering(1015) 00:11:01.006 fused_ordering(1016) 00:11:01.006 fused_ordering(1017) 00:11:01.006 fused_ordering(1018) 00:11:01.006 fused_ordering(1019) 00:11:01.006 fused_ordering(1020) 00:11:01.006 fused_ordering(1021) 00:11:01.006 fused_ordering(1022) 00:11:01.006 fused_ordering(1023) 00:11:01.006 17:59:09 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:11:01.006 17:59:09 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:11:01.006 17:59:09 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:01.006 17:59:09 -- nvmf/common.sh@117 -- # sync 00:11:01.006 17:59:09 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:01.006 17:59:09 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:01.006 17:59:09 -- nvmf/common.sh@120 -- # set +e 00:11:01.006 17:59:09 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:01.006 17:59:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:01.006 rmmod nvme_rdma 00:11:01.006 rmmod nvme_fabrics 00:11:01.006 17:59:10 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:01.006 17:59:10 -- nvmf/common.sh@124 -- # set -e 00:11:01.006 17:59:10 -- nvmf/common.sh@125 -- # return 0 00:11:01.006 17:59:10 -- nvmf/common.sh@478 -- # '[' -n 903465 ']' 00:11:01.006 17:59:10 -- nvmf/common.sh@479 -- # killprocess 903465 00:11:01.006 17:59:10 -- common/autotest_common.sh@946 -- # '[' -z 903465 ']' 00:11:01.006 17:59:10 -- common/autotest_common.sh@950 -- # kill -0 903465 00:11:01.006 17:59:10 -- common/autotest_common.sh@951 -- # uname 00:11:01.006 17:59:10 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:01.006 17:59:10 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 903465 00:11:01.006 17:59:10 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:11:01.006 17:59:10 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:11:01.006 17:59:10 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 903465' 00:11:01.006 killing process with pid 903465 00:11:01.006 17:59:10 -- common/autotest_common.sh@965 -- # kill 903465 00:11:01.006 17:59:10 -- common/autotest_common.sh@970 -- # wait 903465 00:11:01.006 [2024-04-26 17:59:10.128828] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:01.265 17:59:10 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:01.265 17:59:10 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:01.265 00:11:01.265 real 0m8.671s 00:11:01.265 user 0m4.678s 00:11:01.265 sys 0m5.336s 00:11:01.265 17:59:10 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:01.265 17:59:10 -- common/autotest_common.sh@10 -- # set +x 00:11:01.265 ************************************ 00:11:01.265 END TEST nvmf_fused_ordering 00:11:01.265 ************************************ 00:11:01.265 17:59:10 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:11:01.265 17:59:10 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:01.265 17:59:10 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:01.265 17:59:10 -- common/autotest_common.sh@10 -- # set +x 00:11:01.525 ************************************ 00:11:01.525 START TEST nvmf_delete_subsystem 00:11:01.525 ************************************ 00:11:01.525 17:59:10 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=rdma 00:11:01.525 * Looking for test storage... 00:11:01.525 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:01.525 17:59:10 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:01.525 17:59:10 -- nvmf/common.sh@7 -- # uname -s 00:11:01.525 17:59:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:01.525 17:59:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:01.525 17:59:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:01.525 17:59:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:01.525 17:59:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:01.525 17:59:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:01.525 17:59:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:01.525 17:59:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:01.525 17:59:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:01.525 17:59:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:01.525 17:59:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:01.525 17:59:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:01.525 17:59:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:01.525 17:59:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:01.525 17:59:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:01.525 17:59:10 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:01.525 17:59:10 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:01.784 17:59:10 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:01.784 17:59:10 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:01.784 17:59:10 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:01.784 17:59:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:01.784 17:59:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:01.784 17:59:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:01.784 17:59:10 -- paths/export.sh@5 -- # export PATH 00:11:01.784 17:59:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:01.784 17:59:10 -- nvmf/common.sh@47 -- # : 0 00:11:01.784 17:59:10 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:01.784 17:59:10 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:01.784 17:59:10 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:01.784 17:59:10 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:01.784 17:59:10 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:01.784 17:59:10 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:01.784 17:59:10 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:01.784 17:59:10 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:01.784 17:59:10 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:11:01.784 17:59:10 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:01.784 17:59:10 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:01.784 17:59:10 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:01.784 17:59:10 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:01.784 17:59:10 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:01.784 17:59:10 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:01.784 17:59:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:01.784 17:59:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:01.784 17:59:10 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:01.784 17:59:10 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:01.784 17:59:10 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:01.784 17:59:10 -- common/autotest_common.sh@10 -- # set +x 00:11:08.347 17:59:16 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:08.347 17:59:16 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:08.347 17:59:16 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:08.347 17:59:16 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:08.347 17:59:16 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:08.347 17:59:16 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:08.348 17:59:16 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:08.348 17:59:16 -- nvmf/common.sh@295 -- # net_devs=() 00:11:08.348 17:59:16 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:08.348 17:59:16 -- nvmf/common.sh@296 -- # e810=() 00:11:08.348 17:59:16 -- nvmf/common.sh@296 -- # local -ga e810 00:11:08.348 17:59:16 -- nvmf/common.sh@297 -- # x722=() 00:11:08.348 17:59:16 -- nvmf/common.sh@297 -- # local -ga x722 00:11:08.348 17:59:16 -- nvmf/common.sh@298 -- # mlx=() 00:11:08.348 17:59:16 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:08.348 17:59:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:08.348 17:59:16 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:08.348 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:08.348 17:59:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:08.348 17:59:16 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:08.348 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:08.348 17:59:16 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:08.348 17:59:16 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:08.348 17:59:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:08.348 17:59:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:08.348 Found net devices under 0000:18:00.0: mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:08.348 17:59:16 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:08.348 17:59:16 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:08.348 Found net devices under 0000:18:00.1: mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:08.348 17:59:16 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:08.348 17:59:16 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:08.348 17:59:16 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:08.348 17:59:16 -- nvmf/common.sh@58 -- # uname 00:11:08.348 17:59:16 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:08.348 17:59:16 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:08.348 17:59:16 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:08.348 17:59:16 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:08.348 17:59:16 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:08.348 17:59:16 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:08.348 17:59:16 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:08.348 17:59:16 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:08.348 17:59:16 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:08.348 17:59:16 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:08.348 17:59:16 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:08.348 17:59:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:08.348 17:59:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:08.348 17:59:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:08.348 17:59:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:08.348 17:59:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@105 -- # continue 2 00:11:08.348 17:59:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@105 -- # continue 2 00:11:08.348 17:59:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:08.348 17:59:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:08.348 17:59:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:08.348 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:08.348 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:08.348 altname enp24s0f0np0 00:11:08.348 altname ens785f0np0 00:11:08.348 inet 192.168.100.8/24 scope global mlx_0_0 00:11:08.348 valid_lft forever preferred_lft forever 00:11:08.348 17:59:16 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:08.348 17:59:16 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:08.348 17:59:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:08.348 17:59:16 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:08.348 17:59:16 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:08.348 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:08.348 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:08.348 altname enp24s0f1np1 00:11:08.348 altname ens785f1np1 00:11:08.348 inet 192.168.100.9/24 scope global mlx_0_1 00:11:08.348 valid_lft forever preferred_lft forever 00:11:08.348 17:59:16 -- nvmf/common.sh@411 -- # return 0 00:11:08.348 17:59:16 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:08.348 17:59:16 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:08.348 17:59:16 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:08.348 17:59:16 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:08.348 17:59:16 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:08.348 17:59:16 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:08.348 17:59:16 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:08.348 17:59:16 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:08.348 17:59:16 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:08.348 17:59:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:08.348 17:59:16 -- nvmf/common.sh@105 -- # continue 2 00:11:08.348 17:59:16 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:08.348 17:59:16 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:08.348 17:59:16 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:08.348 17:59:16 -- nvmf/common.sh@105 -- # continue 2 00:11:08.348 17:59:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:08.349 17:59:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:08.349 17:59:16 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:08.349 17:59:16 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:08.349 17:59:16 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:08.349 17:59:16 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:08.349 17:59:16 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:08.349 17:59:16 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:08.349 192.168.100.9' 00:11:08.349 17:59:16 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:08.349 192.168.100.9' 00:11:08.349 17:59:16 -- nvmf/common.sh@446 -- # head -n 1 00:11:08.349 17:59:16 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:08.349 17:59:16 -- nvmf/common.sh@447 -- # tail -n +2 00:11:08.349 17:59:16 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:08.349 192.168.100.9' 00:11:08.349 17:59:16 -- nvmf/common.sh@447 -- # head -n 1 00:11:08.349 17:59:16 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:08.349 17:59:16 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:08.349 17:59:16 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:08.349 17:59:16 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:08.349 17:59:16 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:08.349 17:59:16 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:08.349 17:59:16 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:11:08.349 17:59:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:08.349 17:59:16 -- common/autotest_common.sh@720 -- # xtrace_disable 00:11:08.349 17:59:16 -- common/autotest_common.sh@10 -- # set +x 00:11:08.349 17:59:16 -- nvmf/common.sh@470 -- # nvmfpid=906715 00:11:08.349 17:59:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:11:08.349 17:59:16 -- nvmf/common.sh@471 -- # waitforlisten 906715 00:11:08.349 17:59:16 -- common/autotest_common.sh@827 -- # '[' -z 906715 ']' 00:11:08.349 17:59:16 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:08.349 17:59:16 -- common/autotest_common.sh@832 -- # local max_retries=100 00:11:08.349 17:59:16 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:08.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:08.349 17:59:16 -- common/autotest_common.sh@836 -- # xtrace_disable 00:11:08.349 17:59:16 -- common/autotest_common.sh@10 -- # set +x 00:11:08.349 [2024-04-26 17:59:16.812301] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:11:08.349 [2024-04-26 17:59:16.812377] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:08.349 EAL: No free 2048 kB hugepages reported on node 1 00:11:08.349 [2024-04-26 17:59:16.885964] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:11:08.349 [2024-04-26 17:59:16.968145] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:08.349 [2024-04-26 17:59:16.968191] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:08.349 [2024-04-26 17:59:16.968201] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:08.349 [2024-04-26 17:59:16.968210] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:08.349 [2024-04-26 17:59:16.968218] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:08.349 [2024-04-26 17:59:16.968276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:08.349 [2024-04-26 17:59:16.968278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:08.608 17:59:17 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:11:08.608 17:59:17 -- common/autotest_common.sh@860 -- # return 0 00:11:08.608 17:59:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:08.608 17:59:17 -- common/autotest_common.sh@726 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.608 17:59:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:08.608 17:59:17 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:08.608 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.608 [2024-04-26 17:59:17.689494] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x2404f40/0x2409430) succeed. 00:11:08.608 [2024-04-26 17:59:17.698709] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x2406440/0x244aac0) succeed. 00:11:08.608 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.608 17:59:17 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:08.608 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.608 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.608 17:59:17 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:08.608 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.608 [2024-04-26 17:59:17.787506] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:08.608 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.608 17:59:17 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:11:08.608 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.608 NULL1 00:11:08.608 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.608 17:59:17 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:11:08.608 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.608 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.867 Delay0 00:11:08.867 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.867 17:59:17 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:08.867 17:59:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:08.867 17:59:17 -- common/autotest_common.sh@10 -- # set +x 00:11:08.867 17:59:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:08.867 17:59:17 -- target/delete_subsystem.sh@28 -- # perf_pid=906822 00:11:08.867 17:59:17 -- target/delete_subsystem.sh@30 -- # sleep 2 00:11:08.867 17:59:17 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:11:08.867 EAL: No free 2048 kB hugepages reported on node 1 00:11:08.867 [2024-04-26 17:59:17.894425] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:10.769 17:59:19 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:10.769 17:59:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:10.769 17:59:19 -- common/autotest_common.sh@10 -- # set +x 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 NVMe io qpair process completion error 00:11:12.145 17:59:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:12.145 17:59:20 -- target/delete_subsystem.sh@34 -- # delay=0 00:11:12.145 17:59:20 -- target/delete_subsystem.sh@35 -- # kill -0 906822 00:11:12.145 17:59:20 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:12.404 17:59:21 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:12.404 17:59:21 -- target/delete_subsystem.sh@35 -- # kill -0 906822 00:11:12.404 17:59:21 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Write completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.973 Read completed with error (sct=0, sc=8) 00:11:12.973 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 starting I/O failed: -6 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.974 Write completed with error (sct=0, sc=8) 00:11:12.974 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Write completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Write completed with error (sct=0, sc=8) 00:11:12.975 Write completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Write completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 Write completed with error (sct=0, sc=8) 00:11:12.975 Read completed with error (sct=0, sc=8) 00:11:12.975 17:59:21 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:12.975 17:59:21 -- target/delete_subsystem.sh@35 -- # kill -0 906822 00:11:12.975 17:59:21 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:11:12.975 [2024-04-26 17:59:21.993725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:11:12.975 [2024-04-26 17:59:21.993775] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:11:12.975 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:11:12.975 Initializing NVMe Controllers 00:11:12.975 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:12.975 Controller IO queue size 128, less than required. 00:11:12.975 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:12.975 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:12.975 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:12.975 Initialization complete. Launching workers. 00:11:12.975 ======================================================== 00:11:12.975 Latency(us) 00:11:12.975 Device Information : IOPS MiB/s Average min max 00:11:12.975 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 80.49 0.04 1593779.90 1000082.04 2975642.89 00:11:12.975 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 80.49 0.04 1595290.71 1000652.61 2976496.92 00:11:12.975 ======================================================== 00:11:12.975 Total : 160.98 0.08 1594535.30 1000082.04 2976496.92 00:11:12.975 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@35 -- # kill -0 906822 00:11:13.542 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (906822) - No such process 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@45 -- # NOT wait 906822 00:11:13.542 17:59:22 -- common/autotest_common.sh@648 -- # local es=0 00:11:13.542 17:59:22 -- common/autotest_common.sh@650 -- # valid_exec_arg wait 906822 00:11:13.542 17:59:22 -- common/autotest_common.sh@636 -- # local arg=wait 00:11:13.542 17:59:22 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:13.542 17:59:22 -- common/autotest_common.sh@640 -- # type -t wait 00:11:13.542 17:59:22 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:13.542 17:59:22 -- common/autotest_common.sh@651 -- # wait 906822 00:11:13.542 17:59:22 -- common/autotest_common.sh@651 -- # es=1 00:11:13.542 17:59:22 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:13.542 17:59:22 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:13.542 17:59:22 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:11:13.542 17:59:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:13.542 17:59:22 -- common/autotest_common.sh@10 -- # set +x 00:11:13.542 17:59:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:13.542 17:59:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:13.542 17:59:22 -- common/autotest_common.sh@10 -- # set +x 00:11:13.542 [2024-04-26 17:59:22.515460] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:13.542 17:59:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:11:13.542 17:59:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:13.542 17:59:22 -- common/autotest_common.sh@10 -- # set +x 00:11:13.542 17:59:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@54 -- # perf_pid=907474 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@56 -- # delay=0 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:13.542 17:59:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:13.542 EAL: No free 2048 kB hugepages reported on node 1 00:11:13.542 [2024-04-26 17:59:22.608662] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:11:14.109 17:59:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:14.109 17:59:23 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:14.109 17:59:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:14.367 17:59:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:14.367 17:59:23 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:14.367 17:59:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:14.932 17:59:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:14.932 17:59:24 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:14.932 17:59:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:15.498 17:59:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:15.498 17:59:24 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:15.498 17:59:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:16.065 17:59:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:16.065 17:59:25 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:16.065 17:59:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:16.632 17:59:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:16.632 17:59:25 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:16.632 17:59:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:16.890 17:59:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:16.890 17:59:26 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:16.890 17:59:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:17.457 17:59:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:17.457 17:59:26 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:17.457 17:59:26 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:18.024 17:59:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:18.024 17:59:27 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:18.024 17:59:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:18.591 17:59:27 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:18.591 17:59:27 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:18.591 17:59:27 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:19.159 17:59:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:19.159 17:59:28 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:19.159 17:59:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:19.418 17:59:28 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:19.418 17:59:28 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:19.418 17:59:28 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:19.986 17:59:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:19.986 17:59:29 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:19.986 17:59:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:20.553 17:59:29 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:20.553 17:59:29 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:20.553 17:59:29 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:11:20.812 Initializing NVMe Controllers 00:11:20.812 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:11:20.812 Controller IO queue size 128, less than required. 00:11:20.812 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:11:20.812 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:11:20.812 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:11:20.812 Initialization complete. Launching workers. 00:11:20.812 ======================================================== 00:11:20.812 Latency(us) 00:11:20.812 Device Information : IOPS MiB/s Average min max 00:11:20.812 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1001273.08 1000051.12 1004377.54 00:11:20.812 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1002448.00 1000062.70 1007005.55 00:11:20.812 ======================================================== 00:11:20.812 Total : 256.00 0.12 1001860.54 1000051.12 1007005.55 00:11:20.812 00:11:21.071 17:59:30 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:11:21.071 17:59:30 -- target/delete_subsystem.sh@57 -- # kill -0 907474 00:11:21.071 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (907474) - No such process 00:11:21.071 17:59:30 -- target/delete_subsystem.sh@67 -- # wait 907474 00:11:21.071 17:59:30 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:11:21.071 17:59:30 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:11:21.071 17:59:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:21.071 17:59:30 -- nvmf/common.sh@117 -- # sync 00:11:21.071 17:59:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:21.071 17:59:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:21.071 17:59:30 -- nvmf/common.sh@120 -- # set +e 00:11:21.071 17:59:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:21.071 17:59:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:21.071 rmmod nvme_rdma 00:11:21.071 rmmod nvme_fabrics 00:11:21.071 17:59:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:21.071 17:59:30 -- nvmf/common.sh@124 -- # set -e 00:11:21.071 17:59:30 -- nvmf/common.sh@125 -- # return 0 00:11:21.071 17:59:30 -- nvmf/common.sh@478 -- # '[' -n 906715 ']' 00:11:21.071 17:59:30 -- nvmf/common.sh@479 -- # killprocess 906715 00:11:21.071 17:59:30 -- common/autotest_common.sh@946 -- # '[' -z 906715 ']' 00:11:21.071 17:59:30 -- common/autotest_common.sh@950 -- # kill -0 906715 00:11:21.071 17:59:30 -- common/autotest_common.sh@951 -- # uname 00:11:21.071 17:59:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:21.071 17:59:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 906715 00:11:21.071 17:59:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:11:21.071 17:59:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:11:21.071 17:59:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 906715' 00:11:21.071 killing process with pid 906715 00:11:21.071 17:59:30 -- common/autotest_common.sh@965 -- # kill 906715 00:11:21.071 17:59:30 -- common/autotest_common.sh@970 -- # wait 906715 00:11:21.329 [2024-04-26 17:59:30.282750] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:21.329 17:59:30 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:21.329 17:59:30 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:21.329 00:11:21.329 real 0m19.935s 00:11:21.329 user 0m50.014s 00:11:21.330 sys 0m5.883s 00:11:21.330 17:59:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:21.330 17:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:21.330 ************************************ 00:11:21.330 END TEST nvmf_delete_subsystem 00:11:21.330 ************************************ 00:11:21.589 17:59:30 -- nvmf/nvmf.sh@36 -- # run_test nvmf_ns_masking test/nvmf/target/ns_masking.sh --transport=rdma 00:11:21.589 17:59:30 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:21.589 17:59:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:21.589 17:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:21.589 ************************************ 00:11:21.589 START TEST nvmf_ns_masking 00:11:21.589 ************************************ 00:11:21.589 17:59:30 -- common/autotest_common.sh@1121 -- # test/nvmf/target/ns_masking.sh --transport=rdma 00:11:21.848 * Looking for test storage... 00:11:21.848 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:21.848 17:59:30 -- target/ns_masking.sh@8 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:21.848 17:59:30 -- nvmf/common.sh@7 -- # uname -s 00:11:21.848 17:59:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:21.848 17:59:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:21.848 17:59:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:21.848 17:59:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:21.848 17:59:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:21.848 17:59:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:21.848 17:59:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:21.848 17:59:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:21.848 17:59:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:21.848 17:59:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:21.848 17:59:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:21.848 17:59:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:21.848 17:59:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:21.848 17:59:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:21.848 17:59:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:21.848 17:59:30 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:21.848 17:59:30 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:21.848 17:59:30 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:21.848 17:59:30 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:21.848 17:59:30 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:21.848 17:59:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.848 17:59:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.848 17:59:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.848 17:59:30 -- paths/export.sh@5 -- # export PATH 00:11:21.849 17:59:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:21.849 17:59:30 -- nvmf/common.sh@47 -- # : 0 00:11:21.849 17:59:30 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:21.849 17:59:30 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:21.849 17:59:30 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:21.849 17:59:30 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:21.849 17:59:30 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:21.849 17:59:30 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:21.849 17:59:30 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:21.849 17:59:30 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:21.849 17:59:30 -- target/ns_masking.sh@10 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:21.849 17:59:30 -- target/ns_masking.sh@11 -- # loops=5 00:11:21.849 17:59:30 -- target/ns_masking.sh@13 -- # SUBSYSNQN=nqn.2016-06.io.spdk:cnode1 00:11:21.849 17:59:30 -- target/ns_masking.sh@14 -- # HOSTNQN=nqn.2016-06.io.spdk:host1 00:11:21.849 17:59:30 -- target/ns_masking.sh@15 -- # uuidgen 00:11:21.849 17:59:30 -- target/ns_masking.sh@15 -- # HOSTID=fbee3277-9b25-483a-8e64-609bae3cdbf0 00:11:21.849 17:59:30 -- target/ns_masking.sh@44 -- # nvmftestinit 00:11:21.849 17:59:30 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:21.849 17:59:30 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:21.849 17:59:30 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:21.849 17:59:30 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:21.849 17:59:30 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:21.849 17:59:30 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:21.849 17:59:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:21.849 17:59:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:21.849 17:59:30 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:21.849 17:59:30 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:21.849 17:59:30 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:21.849 17:59:30 -- common/autotest_common.sh@10 -- # set +x 00:11:28.469 17:59:36 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:28.469 17:59:36 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:28.469 17:59:36 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:28.469 17:59:36 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:28.469 17:59:36 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:28.469 17:59:36 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:28.469 17:59:36 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:28.469 17:59:36 -- nvmf/common.sh@295 -- # net_devs=() 00:11:28.469 17:59:36 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:28.469 17:59:36 -- nvmf/common.sh@296 -- # e810=() 00:11:28.469 17:59:36 -- nvmf/common.sh@296 -- # local -ga e810 00:11:28.469 17:59:36 -- nvmf/common.sh@297 -- # x722=() 00:11:28.469 17:59:36 -- nvmf/common.sh@297 -- # local -ga x722 00:11:28.469 17:59:36 -- nvmf/common.sh@298 -- # mlx=() 00:11:28.469 17:59:36 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:28.469 17:59:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:28.469 17:59:36 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:28.469 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:28.469 17:59:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:28.469 17:59:36 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:28.469 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:28.469 17:59:36 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:28.469 17:59:36 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.469 17:59:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.469 17:59:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:28.469 Found net devices under 0000:18:00.0: mlx_0_0 00:11:28.469 17:59:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:28.469 17:59:36 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:28.469 17:59:36 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:28.469 Found net devices under 0000:18:00.1: mlx_0_1 00:11:28.469 17:59:36 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:28.469 17:59:36 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:28.469 17:59:36 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:28.469 17:59:36 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:28.469 17:59:36 -- nvmf/common.sh@58 -- # uname 00:11:28.469 17:59:36 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:28.469 17:59:36 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:28.469 17:59:36 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:28.469 17:59:36 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:28.469 17:59:36 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:28.469 17:59:36 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:28.469 17:59:36 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:28.469 17:59:36 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:28.469 17:59:36 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:28.469 17:59:36 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:28.469 17:59:36 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:28.469 17:59:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:28.469 17:59:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:28.469 17:59:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:28.469 17:59:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:28.469 17:59:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:28.469 17:59:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:28.469 17:59:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:28.469 17:59:36 -- nvmf/common.sh@105 -- # continue 2 00:11:28.469 17:59:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.469 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@105 -- # continue 2 00:11:28.470 17:59:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:28.470 17:59:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:28.470 17:59:36 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:28.470 17:59:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:28.470 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:28.470 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:28.470 altname enp24s0f0np0 00:11:28.470 altname ens785f0np0 00:11:28.470 inet 192.168.100.8/24 scope global mlx_0_0 00:11:28.470 valid_lft forever preferred_lft forever 00:11:28.470 17:59:36 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:28.470 17:59:36 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:28.470 17:59:36 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:28.470 17:59:36 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:28.470 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:28.470 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:28.470 altname enp24s0f1np1 00:11:28.470 altname ens785f1np1 00:11:28.470 inet 192.168.100.9/24 scope global mlx_0_1 00:11:28.470 valid_lft forever preferred_lft forever 00:11:28.470 17:59:36 -- nvmf/common.sh@411 -- # return 0 00:11:28.470 17:59:36 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:28.470 17:59:36 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:28.470 17:59:36 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:28.470 17:59:36 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:28.470 17:59:36 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:28.470 17:59:36 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:28.470 17:59:36 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:28.470 17:59:36 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:28.470 17:59:36 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:28.470 17:59:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@105 -- # continue 2 00:11:28.470 17:59:36 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:28.470 17:59:36 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:28.470 17:59:36 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@105 -- # continue 2 00:11:28.470 17:59:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:28.470 17:59:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:28.470 17:59:36 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:28.470 17:59:36 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:28.470 17:59:36 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:28.470 17:59:36 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:28.470 192.168.100.9' 00:11:28.470 17:59:36 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:28.470 192.168.100.9' 00:11:28.470 17:59:36 -- nvmf/common.sh@446 -- # head -n 1 00:11:28.470 17:59:36 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:28.470 17:59:36 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:28.470 192.168.100.9' 00:11:28.470 17:59:36 -- nvmf/common.sh@447 -- # tail -n +2 00:11:28.470 17:59:36 -- nvmf/common.sh@447 -- # head -n 1 00:11:28.470 17:59:36 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:28.470 17:59:36 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:28.470 17:59:36 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:28.470 17:59:36 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:28.470 17:59:36 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:28.470 17:59:36 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:28.470 17:59:36 -- target/ns_masking.sh@45 -- # nvmfappstart -m 0xF 00:11:28.470 17:59:36 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:28.470 17:59:36 -- common/autotest_common.sh@720 -- # xtrace_disable 00:11:28.470 17:59:36 -- common/autotest_common.sh@10 -- # set +x 00:11:28.470 17:59:36 -- nvmf/common.sh@470 -- # nvmfpid=911313 00:11:28.470 17:59:36 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:28.470 17:59:36 -- nvmf/common.sh@471 -- # waitforlisten 911313 00:11:28.470 17:59:36 -- common/autotest_common.sh@827 -- # '[' -z 911313 ']' 00:11:28.470 17:59:36 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:28.470 17:59:36 -- common/autotest_common.sh@832 -- # local max_retries=100 00:11:28.470 17:59:36 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:28.470 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:28.470 17:59:36 -- common/autotest_common.sh@836 -- # xtrace_disable 00:11:28.470 17:59:36 -- common/autotest_common.sh@10 -- # set +x 00:11:28.470 [2024-04-26 17:59:36.899065] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:11:28.470 [2024-04-26 17:59:36.899121] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:28.470 EAL: No free 2048 kB hugepages reported on node 1 00:11:28.470 [2024-04-26 17:59:36.973067] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:28.470 [2024-04-26 17:59:37.059759] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:28.470 [2024-04-26 17:59:37.059804] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:28.470 [2024-04-26 17:59:37.059814] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:28.470 [2024-04-26 17:59:37.059823] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:28.470 [2024-04-26 17:59:37.059830] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:28.470 [2024-04-26 17:59:37.059880] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:28.470 [2024-04-26 17:59:37.059969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:28.470 [2024-04-26 17:59:37.060045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:28.470 [2024-04-26 17:59:37.060047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:28.729 17:59:37 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:11:28.729 17:59:37 -- common/autotest_common.sh@860 -- # return 0 00:11:28.729 17:59:37 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:28.729 17:59:37 -- common/autotest_common.sh@726 -- # xtrace_disable 00:11:28.729 17:59:37 -- common/autotest_common.sh@10 -- # set +x 00:11:28.729 17:59:37 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:28.729 17:59:37 -- target/ns_masking.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:28.989 [2024-04-26 17:59:37.929208] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x21d64d0/0x21da9c0) succeed. 00:11:28.989 [2024-04-26 17:59:37.939723] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x21d7b10/0x221c050) succeed. 00:11:28.989 17:59:38 -- target/ns_masking.sh@49 -- # MALLOC_BDEV_SIZE=64 00:11:28.989 17:59:38 -- target/ns_masking.sh@50 -- # MALLOC_BLOCK_SIZE=512 00:11:28.989 17:59:38 -- target/ns_masking.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:11:29.247 Malloc1 00:11:29.247 17:59:38 -- target/ns_masking.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:11:29.506 Malloc2 00:11:29.506 17:59:38 -- target/ns_masking.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:11:29.506 17:59:38 -- target/ns_masking.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 00:11:29.766 17:59:38 -- target/ns_masking.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:30.029 [2024-04-26 17:59:39.027613] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:30.029 17:59:39 -- target/ns_masking.sh@61 -- # connect 00:11:30.029 17:59:39 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I fbee3277-9b25-483a-8e64-609bae3cdbf0 -a 192.168.100.8 -s 4420 -i 4 00:11:30.294 17:59:39 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 00:11:30.294 17:59:39 -- common/autotest_common.sh@1194 -- # local i=0 00:11:30.294 17:59:39 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:11:30.294 17:59:39 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:11:30.294 17:59:39 -- common/autotest_common.sh@1201 -- # sleep 2 00:11:32.197 17:59:41 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:11:32.197 17:59:41 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:11:32.197 17:59:41 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:11:32.197 17:59:41 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:11:32.197 17:59:41 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:11:32.197 17:59:41 -- common/autotest_common.sh@1204 -- # return 0 00:11:32.197 17:59:41 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:32.197 17:59:41 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:32.455 17:59:41 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:32.455 17:59:41 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:32.455 17:59:41 -- target/ns_masking.sh@62 -- # ns_is_visible 0x1 00:11:32.455 17:59:41 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:32.455 17:59:41 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:32.455 [ 0]:0x1 00:11:32.455 17:59:41 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:32.455 17:59:41 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:32.455 17:59:41 -- target/ns_masking.sh@40 -- # nguid=3058bb4067574b37999e0727fb010839 00:11:32.455 17:59:41 -- target/ns_masking.sh@41 -- # [[ 3058bb4067574b37999e0727fb010839 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:32.455 17:59:41 -- target/ns_masking.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc2 -n 2 00:11:32.715 17:59:41 -- target/ns_masking.sh@66 -- # ns_is_visible 0x1 00:11:32.715 17:59:41 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:32.715 17:59:41 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:32.715 [ 0]:0x1 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # nguid=3058bb4067574b37999e0727fb010839 00:11:32.715 17:59:41 -- target/ns_masking.sh@41 -- # [[ 3058bb4067574b37999e0727fb010839 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:32.715 17:59:41 -- target/ns_masking.sh@67 -- # ns_is_visible 0x2 00:11:32.715 17:59:41 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:32.715 17:59:41 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:32.715 [ 1]:0x2 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:32.715 17:59:41 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:32.715 17:59:41 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:32.715 17:59:41 -- target/ns_masking.sh@69 -- # disconnect 00:11:32.715 17:59:41 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:32.973 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.974 17:59:42 -- target/ns_masking.sh@73 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:11:33.232 17:59:42 -- target/ns_masking.sh@74 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 1 --no-auto-visible 00:11:33.492 17:59:42 -- target/ns_masking.sh@77 -- # connect 1 00:11:33.492 17:59:42 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I fbee3277-9b25-483a-8e64-609bae3cdbf0 -a 192.168.100.8 -s 4420 -i 4 00:11:33.751 17:59:42 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 1 00:11:33.751 17:59:42 -- common/autotest_common.sh@1194 -- # local i=0 00:11:33.751 17:59:42 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:11:33.751 17:59:42 -- common/autotest_common.sh@1196 -- # [[ -n 1 ]] 00:11:33.751 17:59:42 -- common/autotest_common.sh@1197 -- # nvme_device_counter=1 00:11:33.751 17:59:42 -- common/autotest_common.sh@1201 -- # sleep 2 00:11:35.652 17:59:44 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:11:35.652 17:59:44 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:11:35.652 17:59:44 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:11:35.652 17:59:44 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:11:35.652 17:59:44 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:11:35.652 17:59:44 -- common/autotest_common.sh@1204 -- # return 0 00:11:35.652 17:59:44 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:35.652 17:59:44 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:35.911 17:59:44 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:35.911 17:59:44 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:35.911 17:59:44 -- target/ns_masking.sh@78 -- # NOT ns_is_visible 0x1 00:11:35.911 17:59:44 -- common/autotest_common.sh@648 -- # local es=0 00:11:35.911 17:59:44 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:11:35.911 17:59:44 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:11:35.911 17:59:44 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:35.911 17:59:44 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:11:35.911 17:59:44 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:35.911 17:59:44 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:11:35.911 17:59:44 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:35.911 17:59:44 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:35.911 17:59:44 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:35.911 17:59:44 -- common/autotest_common.sh@651 -- # es=1 00:11:35.911 17:59:44 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:35.911 17:59:44 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:35.911 17:59:44 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:35.911 17:59:44 -- target/ns_masking.sh@79 -- # ns_is_visible 0x2 00:11:35.911 17:59:44 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:35.911 17:59:44 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:35.911 [ 0]:0x2 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:35.911 17:59:44 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:35.911 17:59:44 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:35.911 17:59:44 -- target/ns_masking.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:36.170 17:59:45 -- target/ns_masking.sh@83 -- # ns_is_visible 0x1 00:11:36.170 17:59:45 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:36.170 17:59:45 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:36.170 [ 0]:0x1 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # nguid=3058bb4067574b37999e0727fb010839 00:11:36.170 17:59:45 -- target/ns_masking.sh@41 -- # [[ 3058bb4067574b37999e0727fb010839 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:36.170 17:59:45 -- target/ns_masking.sh@84 -- # ns_is_visible 0x2 00:11:36.170 17:59:45 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:36.170 17:59:45 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:36.170 [ 1]:0x2 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:36.170 17:59:45 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:36.170 17:59:45 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:36.170 17:59:45 -- target/ns_masking.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:36.429 17:59:45 -- target/ns_masking.sh@88 -- # NOT ns_is_visible 0x1 00:11:36.429 17:59:45 -- common/autotest_common.sh@648 -- # local es=0 00:11:36.429 17:59:45 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:11:36.429 17:59:45 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:11:36.429 17:59:45 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:36.429 17:59:45 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:11:36.429 17:59:45 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:36.429 17:59:45 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:11:36.429 17:59:45 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:36.429 17:59:45 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:36.429 17:59:45 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:36.429 17:59:45 -- common/autotest_common.sh@651 -- # es=1 00:11:36.429 17:59:45 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:36.429 17:59:45 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:36.429 17:59:45 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:36.429 17:59:45 -- target/ns_masking.sh@89 -- # ns_is_visible 0x2 00:11:36.429 17:59:45 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:36.429 17:59:45 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:36.429 [ 0]:0x2 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:36.429 17:59:45 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:36.429 17:59:45 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:36.429 17:59:45 -- target/ns_masking.sh@91 -- # disconnect 00:11:36.429 17:59:45 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:36.711 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.711 17:59:45 -- target/ns_masking.sh@94 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_add_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:36.970 17:59:46 -- target/ns_masking.sh@95 -- # connect 2 00:11:36.970 17:59:46 -- target/ns_masking.sh@18 -- # nvme connect -t rdma -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 -I fbee3277-9b25-483a-8e64-609bae3cdbf0 -a 192.168.100.8 -s 4420 -i 4 00:11:37.228 17:59:46 -- target/ns_masking.sh@20 -- # waitforserial SPDKISFASTANDAWESOME 2 00:11:37.228 17:59:46 -- common/autotest_common.sh@1194 -- # local i=0 00:11:37.228 17:59:46 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:11:37.228 17:59:46 -- common/autotest_common.sh@1196 -- # [[ -n 2 ]] 00:11:37.228 17:59:46 -- common/autotest_common.sh@1197 -- # nvme_device_counter=2 00:11:37.228 17:59:46 -- common/autotest_common.sh@1201 -- # sleep 2 00:11:39.761 17:59:48 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:11:39.761 17:59:48 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:11:39.761 17:59:48 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:11:39.761 17:59:48 -- common/autotest_common.sh@1203 -- # nvme_devices=2 00:11:39.761 17:59:48 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:11:39.761 17:59:48 -- common/autotest_common.sh@1204 -- # return 0 00:11:39.761 17:59:48 -- target/ns_masking.sh@22 -- # nvme list-subsys -o json 00:11:39.761 17:59:48 -- target/ns_masking.sh@22 -- # jq -r '.[].Subsystems[] | select(.NQN=="nqn.2016-06.io.spdk:cnode1") | .Paths[0].Name' 00:11:39.761 17:59:48 -- target/ns_masking.sh@22 -- # ctrl_id=nvme0 00:11:39.761 17:59:48 -- target/ns_masking.sh@23 -- # [[ -z nvme0 ]] 00:11:39.761 17:59:48 -- target/ns_masking.sh@96 -- # ns_is_visible 0x1 00:11:39.761 17:59:48 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:39.761 17:59:48 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:39.761 [ 0]:0x1 00:11:39.761 17:59:48 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:39.761 17:59:48 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:39.761 17:59:48 -- target/ns_masking.sh@40 -- # nguid=3058bb4067574b37999e0727fb010839 00:11:39.761 17:59:48 -- target/ns_masking.sh@41 -- # [[ 3058bb4067574b37999e0727fb010839 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:39.761 17:59:48 -- target/ns_masking.sh@97 -- # ns_is_visible 0x2 00:11:39.761 17:59:48 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:39.761 17:59:48 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:39.761 [ 1]:0x2 00:11:39.761 17:59:48 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:39.762 17:59:48 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:39.762 17:59:48 -- target/ns_masking.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 1 nqn.2016-06.io.spdk:host1 00:11:39.762 17:59:48 -- target/ns_masking.sh@101 -- # NOT ns_is_visible 0x1 00:11:39.762 17:59:48 -- common/autotest_common.sh@648 -- # local es=0 00:11:39.762 17:59:48 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:11:39.762 17:59:48 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:39.762 17:59:48 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:11:39.762 17:59:48 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:39.762 17:59:48 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:39.762 17:59:48 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:39.762 17:59:48 -- common/autotest_common.sh@651 -- # es=1 00:11:39.762 17:59:48 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:39.762 17:59:48 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:39.762 17:59:48 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:39.762 17:59:48 -- target/ns_masking.sh@102 -- # ns_is_visible 0x2 00:11:39.762 17:59:48 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:39.762 17:59:48 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:39.762 [ 0]:0x2 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:39.762 17:59:48 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:39.762 17:59:48 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:39.762 17:59:48 -- target/ns_masking.sh@105 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:39.762 17:59:48 -- common/autotest_common.sh@648 -- # local es=0 00:11:39.762 17:59:48 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:39.762 17:59:48 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:39.762 17:59:48 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:39.762 17:59:48 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:39.762 17:59:48 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:11:39.762 17:59:48 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:11:39.762 17:59:48 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_ns_remove_host nqn.2016-06.io.spdk:cnode1 2 nqn.2016-06.io.spdk:host1 00:11:40.021 [2024-04-26 17:59:48.972695] nvmf_rpc.c:1779:nvmf_rpc_ns_visible_paused: *ERROR*: Unable to add/remove nqn.2016-06.io.spdk:host1 to namespace ID 2 00:11:40.021 request: 00:11:40.021 { 00:11:40.021 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:11:40.021 "nsid": 2, 00:11:40.021 "host": "nqn.2016-06.io.spdk:host1", 00:11:40.021 "method": "nvmf_ns_remove_host", 00:11:40.021 "req_id": 1 00:11:40.021 } 00:11:40.021 Got JSON-RPC error response 00:11:40.021 response: 00:11:40.021 { 00:11:40.021 "code": -32602, 00:11:40.021 "message": "Invalid parameters" 00:11:40.021 } 00:11:40.021 17:59:49 -- common/autotest_common.sh@651 -- # es=1 00:11:40.021 17:59:49 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:40.021 17:59:49 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:40.021 17:59:49 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:40.021 17:59:49 -- target/ns_masking.sh@106 -- # NOT ns_is_visible 0x1 00:11:40.021 17:59:49 -- common/autotest_common.sh@648 -- # local es=0 00:11:40.021 17:59:49 -- common/autotest_common.sh@650 -- # valid_exec_arg ns_is_visible 0x1 00:11:40.021 17:59:49 -- common/autotest_common.sh@636 -- # local arg=ns_is_visible 00:11:40.021 17:59:49 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:40.021 17:59:49 -- common/autotest_common.sh@640 -- # type -t ns_is_visible 00:11:40.021 17:59:49 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:11:40.021 17:59:49 -- common/autotest_common.sh@651 -- # ns_is_visible 0x1 00:11:40.021 17:59:49 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:40.021 17:59:49 -- target/ns_masking.sh@39 -- # grep 0x1 00:11:40.021 17:59:49 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x1 -o json 00:11:40.021 17:59:49 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:40.021 17:59:49 -- target/ns_masking.sh@40 -- # nguid=00000000000000000000000000000000 00:11:40.021 17:59:49 -- target/ns_masking.sh@41 -- # [[ 00000000000000000000000000000000 != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:40.021 17:59:49 -- common/autotest_common.sh@651 -- # es=1 00:11:40.021 17:59:49 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:11:40.022 17:59:49 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:11:40.022 17:59:49 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:11:40.022 17:59:49 -- target/ns_masking.sh@107 -- # ns_is_visible 0x2 00:11:40.022 17:59:49 -- target/ns_masking.sh@39 -- # nvme list-ns /dev/nvme0 00:11:40.022 17:59:49 -- target/ns_masking.sh@39 -- # grep 0x2 00:11:40.022 [ 0]:0x2 00:11:40.022 17:59:49 -- target/ns_masking.sh@40 -- # nvme id-ns /dev/nvme0 -n 0x2 -o json 00:11:40.022 17:59:49 -- target/ns_masking.sh@40 -- # jq -r .nguid 00:11:40.022 17:59:49 -- target/ns_masking.sh@40 -- # nguid=25ccd99510fb4b75bbcfdb170e35e2fb 00:11:40.022 17:59:49 -- target/ns_masking.sh@41 -- # [[ 25ccd99510fb4b75bbcfdb170e35e2fb != \0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0 ]] 00:11:40.022 17:59:49 -- target/ns_masking.sh@108 -- # disconnect 00:11:40.022 17:59:49 -- target/ns_masking.sh@34 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:40.281 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.281 17:59:49 -- target/ns_masking.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:40.541 17:59:49 -- target/ns_masking.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:11:40.541 17:59:49 -- target/ns_masking.sh@114 -- # nvmftestfini 00:11:40.541 17:59:49 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:40.541 17:59:49 -- nvmf/common.sh@117 -- # sync 00:11:40.541 17:59:49 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:40.541 17:59:49 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:40.541 17:59:49 -- nvmf/common.sh@120 -- # set +e 00:11:40.541 17:59:49 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:40.541 17:59:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:40.541 rmmod nvme_rdma 00:11:40.541 rmmod nvme_fabrics 00:11:40.541 17:59:49 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:40.541 17:59:49 -- nvmf/common.sh@124 -- # set -e 00:11:40.541 17:59:49 -- nvmf/common.sh@125 -- # return 0 00:11:40.541 17:59:49 -- nvmf/common.sh@478 -- # '[' -n 911313 ']' 00:11:40.541 17:59:49 -- nvmf/common.sh@479 -- # killprocess 911313 00:11:40.541 17:59:49 -- common/autotest_common.sh@946 -- # '[' -z 911313 ']' 00:11:40.541 17:59:49 -- common/autotest_common.sh@950 -- # kill -0 911313 00:11:40.541 17:59:49 -- common/autotest_common.sh@951 -- # uname 00:11:40.541 17:59:49 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:40.541 17:59:49 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 911313 00:11:40.541 17:59:49 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:11:40.541 17:59:49 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:11:40.541 17:59:49 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 911313' 00:11:40.541 killing process with pid 911313 00:11:40.541 17:59:49 -- common/autotest_common.sh@965 -- # kill 911313 00:11:40.541 17:59:49 -- common/autotest_common.sh@970 -- # wait 911313 00:11:40.800 [2024-04-26 17:59:49.800082] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:41.060 17:59:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:41.060 17:59:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:41.060 00:11:41.060 real 0m19.395s 00:11:41.060 user 0m56.367s 00:11:41.060 sys 0m6.091s 00:11:41.060 17:59:50 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:41.060 17:59:50 -- common/autotest_common.sh@10 -- # set +x 00:11:41.060 ************************************ 00:11:41.060 END TEST nvmf_ns_masking 00:11:41.060 ************************************ 00:11:41.060 17:59:50 -- nvmf/nvmf.sh@37 -- # [[ 1 -eq 1 ]] 00:11:41.060 17:59:50 -- nvmf/nvmf.sh@38 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:11:41.060 17:59:50 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:41.060 17:59:50 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:41.060 17:59:50 -- common/autotest_common.sh@10 -- # set +x 00:11:41.320 ************************************ 00:11:41.320 START TEST nvmf_nvme_cli 00:11:41.320 ************************************ 00:11:41.320 17:59:50 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=rdma 00:11:41.320 * Looking for test storage... 00:11:41.320 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:41.320 17:59:50 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:41.320 17:59:50 -- nvmf/common.sh@7 -- # uname -s 00:11:41.320 17:59:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:41.320 17:59:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:41.320 17:59:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:41.320 17:59:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:41.320 17:59:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:41.320 17:59:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:41.320 17:59:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:41.320 17:59:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:41.320 17:59:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:41.320 17:59:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:41.320 17:59:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:41.320 17:59:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:41.320 17:59:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:41.320 17:59:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:41.320 17:59:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:41.320 17:59:50 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:41.320 17:59:50 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:41.320 17:59:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:41.320 17:59:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:41.320 17:59:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:41.320 17:59:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:41.320 17:59:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:41.320 17:59:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:41.320 17:59:50 -- paths/export.sh@5 -- # export PATH 00:11:41.320 17:59:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:41.320 17:59:50 -- nvmf/common.sh@47 -- # : 0 00:11:41.320 17:59:50 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:41.320 17:59:50 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:41.320 17:59:50 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:41.320 17:59:50 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:41.320 17:59:50 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:41.320 17:59:50 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:41.320 17:59:50 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:41.320 17:59:50 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:41.320 17:59:50 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:41.320 17:59:50 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:41.320 17:59:50 -- target/nvme_cli.sh@14 -- # devs=() 00:11:41.320 17:59:50 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:11:41.320 17:59:50 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:41.320 17:59:50 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:41.321 17:59:50 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:41.321 17:59:50 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:41.321 17:59:50 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:41.321 17:59:50 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:41.321 17:59:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:41.321 17:59:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:41.321 17:59:50 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:41.321 17:59:50 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:41.321 17:59:50 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:41.321 17:59:50 -- common/autotest_common.sh@10 -- # set +x 00:11:47.893 17:59:56 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:47.893 17:59:56 -- nvmf/common.sh@291 -- # pci_devs=() 00:11:47.893 17:59:56 -- nvmf/common.sh@291 -- # local -a pci_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:11:47.893 17:59:56 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@293 -- # pci_drivers=() 00:11:47.893 17:59:56 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:11:47.893 17:59:56 -- nvmf/common.sh@295 -- # net_devs=() 00:11:47.893 17:59:56 -- nvmf/common.sh@295 -- # local -ga net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@296 -- # e810=() 00:11:47.893 17:59:56 -- nvmf/common.sh@296 -- # local -ga e810 00:11:47.893 17:59:56 -- nvmf/common.sh@297 -- # x722=() 00:11:47.893 17:59:56 -- nvmf/common.sh@297 -- # local -ga x722 00:11:47.893 17:59:56 -- nvmf/common.sh@298 -- # mlx=() 00:11:47.893 17:59:56 -- nvmf/common.sh@298 -- # local -ga mlx 00:11:47.893 17:59:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:47.893 17:59:56 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:11:47.893 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:11:47.893 17:59:56 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:47.893 17:59:56 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:11:47.893 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:11:47.893 17:59:56 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:11:47.893 17:59:56 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:47.893 17:59:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:47.893 17:59:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:11:47.893 Found net devices under 0000:18:00.0: mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:47.893 17:59:56 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:47.893 17:59:56 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:11:47.893 Found net devices under 0000:18:00.1: mlx_0_1 00:11:47.893 17:59:56 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:11:47.893 17:59:56 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@403 -- # is_hw=yes 00:11:47.893 17:59:56 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@409 -- # rdma_device_init 00:11:47.893 17:59:56 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:11:47.893 17:59:56 -- nvmf/common.sh@58 -- # uname 00:11:47.893 17:59:56 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:11:47.893 17:59:56 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:11:47.893 17:59:56 -- nvmf/common.sh@63 -- # modprobe ib_core 00:11:47.893 17:59:56 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:11:47.893 17:59:56 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:11:47.893 17:59:56 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:11:47.893 17:59:56 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:11:47.893 17:59:56 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:11:47.893 17:59:56 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:11:47.893 17:59:56 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:11:47.893 17:59:56 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:11:47.893 17:59:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:47.893 17:59:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:47.893 17:59:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@105 -- # continue 2 00:11:47.893 17:59:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:47.893 17:59:56 -- nvmf/common.sh@105 -- # continue 2 00:11:47.893 17:59:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:47.893 17:59:56 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:47.893 17:59:56 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:11:47.893 17:59:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:11:47.893 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:47.893 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:11:47.893 altname enp24s0f0np0 00:11:47.893 altname ens785f0np0 00:11:47.893 inet 192.168.100.8/24 scope global mlx_0_0 00:11:47.893 valid_lft forever preferred_lft forever 00:11:47.893 17:59:56 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:11:47.893 17:59:56 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:11:47.893 17:59:56 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:47.893 17:59:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:47.893 17:59:56 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:11:47.893 17:59:56 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:11:47.893 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:11:47.893 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:11:47.893 altname enp24s0f1np1 00:11:47.893 altname ens785f1np1 00:11:47.893 inet 192.168.100.9/24 scope global mlx_0_1 00:11:47.893 valid_lft forever preferred_lft forever 00:11:47.893 17:59:56 -- nvmf/common.sh@411 -- # return 0 00:11:47.893 17:59:56 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:11:47.893 17:59:56 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:11:47.893 17:59:56 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:11:47.893 17:59:56 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:11:47.893 17:59:56 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:11:47.893 17:59:56 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:11:47.893 17:59:56 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:11:47.893 17:59:56 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:11:47.893 17:59:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:11:47.893 17:59:56 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:11:47.893 17:59:56 -- nvmf/common.sh@105 -- # continue 2 00:11:47.893 17:59:56 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:11:47.893 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.894 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:11:47.894 17:59:56 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:11:47.894 17:59:56 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:11:47.894 17:59:56 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:11:47.894 17:59:56 -- nvmf/common.sh@105 -- # continue 2 00:11:47.894 17:59:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:47.894 17:59:56 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:11:47.894 17:59:56 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:11:47.894 17:59:56 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:11:47.894 17:59:56 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:11:47.894 17:59:56 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:11:47.894 17:59:56 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:11:47.894 17:59:56 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:11:47.894 192.168.100.9' 00:11:47.894 17:59:56 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:11:47.894 192.168.100.9' 00:11:47.894 17:59:56 -- nvmf/common.sh@446 -- # head -n 1 00:11:47.894 17:59:56 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:11:47.894 17:59:56 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:11:47.894 192.168.100.9' 00:11:47.894 17:59:56 -- nvmf/common.sh@447 -- # tail -n +2 00:11:47.894 17:59:56 -- nvmf/common.sh@447 -- # head -n 1 00:11:47.894 17:59:56 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:11:47.894 17:59:56 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:11:47.894 17:59:56 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:11:47.894 17:59:56 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:11:47.894 17:59:56 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:11:47.894 17:59:56 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:11:47.894 17:59:56 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:11:47.894 17:59:56 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:11:47.894 17:59:56 -- common/autotest_common.sh@720 -- # xtrace_disable 00:11:47.894 17:59:56 -- common/autotest_common.sh@10 -- # set +x 00:11:47.894 17:59:56 -- nvmf/common.sh@470 -- # nvmfpid=916026 00:11:47.894 17:59:56 -- nvmf/common.sh@471 -- # waitforlisten 916026 00:11:47.894 17:59:56 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:47.894 17:59:56 -- common/autotest_common.sh@827 -- # '[' -z 916026 ']' 00:11:47.894 17:59:56 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:47.894 17:59:56 -- common/autotest_common.sh@832 -- # local max_retries=100 00:11:47.894 17:59:56 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:47.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:47.894 17:59:56 -- common/autotest_common.sh@836 -- # xtrace_disable 00:11:47.894 17:59:56 -- common/autotest_common.sh@10 -- # set +x 00:11:47.894 [2024-04-26 17:59:56.454025] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:11:47.894 [2024-04-26 17:59:56.454084] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:47.894 EAL: No free 2048 kB hugepages reported on node 1 00:11:47.894 [2024-04-26 17:59:56.526077] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:47.894 [2024-04-26 17:59:56.616574] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:47.894 [2024-04-26 17:59:56.616616] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:47.894 [2024-04-26 17:59:56.616627] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:11:47.894 [2024-04-26 17:59:56.616637] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:11:47.894 [2024-04-26 17:59:56.616646] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:47.894 [2024-04-26 17:59:56.616700] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:47.894 [2024-04-26 17:59:56.616716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:47.894 [2024-04-26 17:59:56.616735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:47.894 [2024-04-26 17:59:56.616737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:48.152 17:59:57 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:11:48.153 17:59:57 -- common/autotest_common.sh@860 -- # return 0 00:11:48.153 17:59:57 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:11:48.153 17:59:57 -- common/autotest_common.sh@726 -- # xtrace_disable 00:11:48.153 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.153 17:59:57 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:48.153 17:59:57 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:11:48.153 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.153 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 [2024-04-26 17:59:57.352773] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x87e4d0/0x8829c0) succeed. 00:11:48.411 [2024-04-26 17:59:57.363178] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x87fb10/0x8c4050) succeed. 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 Malloc0 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 Malloc1 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 [2024-04-26 17:59:57.572750] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:11:48.411 17:59:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:48.411 17:59:57 -- common/autotest_common.sh@10 -- # set +x 00:11:48.411 17:59:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:48.411 17:59:57 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -a 192.168.100.8 -s 4420 00:11:48.670 00:11:48.670 Discovery Log Number of Records 2, Generation counter 2 00:11:48.670 =====Discovery Log Entry 0====== 00:11:48.670 trtype: rdma 00:11:48.670 adrfam: ipv4 00:11:48.670 subtype: current discovery subsystem 00:11:48.670 treq: not required 00:11:48.670 portid: 0 00:11:48.670 trsvcid: 4420 00:11:48.670 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:11:48.670 traddr: 192.168.100.8 00:11:48.670 eflags: explicit discovery connections, duplicate discovery information 00:11:48.670 rdma_prtype: not specified 00:11:48.670 rdma_qptype: connected 00:11:48.670 rdma_cms: rdma-cm 00:11:48.670 rdma_pkey: 0x0000 00:11:48.670 =====Discovery Log Entry 1====== 00:11:48.670 trtype: rdma 00:11:48.670 adrfam: ipv4 00:11:48.670 subtype: nvme subsystem 00:11:48.670 treq: not required 00:11:48.670 portid: 0 00:11:48.670 trsvcid: 4420 00:11:48.670 subnqn: nqn.2016-06.io.spdk:cnode1 00:11:48.670 traddr: 192.168.100.8 00:11:48.670 eflags: none 00:11:48.670 rdma_prtype: not specified 00:11:48.670 rdma_qptype: connected 00:11:48.670 rdma_cms: rdma-cm 00:11:48.670 rdma_pkey: 0x0000 00:11:48.670 17:59:57 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:11:48.670 17:59:57 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:11:48.670 17:59:57 -- nvmf/common.sh@511 -- # local dev _ 00:11:48.670 17:59:57 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:48.670 17:59:57 -- nvmf/common.sh@510 -- # nvme list 00:11:48.670 17:59:57 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:48.670 17:59:57 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:48.670 17:59:57 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:48.670 17:59:57 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:48.670 17:59:57 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:11:48.670 17:59:57 -- target/nvme_cli.sh@32 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:11:49.604 17:59:58 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:11:49.604 17:59:58 -- common/autotest_common.sh@1194 -- # local i=0 00:11:49.604 17:59:58 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:11:49.604 17:59:58 -- common/autotest_common.sh@1196 -- # [[ -n 2 ]] 00:11:49.604 17:59:58 -- common/autotest_common.sh@1197 -- # nvme_device_counter=2 00:11:49.604 17:59:58 -- common/autotest_common.sh@1201 -- # sleep 2 00:11:51.563 18:00:00 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:11:51.563 18:00:00 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:11:51.563 18:00:00 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:11:51.563 18:00:00 -- common/autotest_common.sh@1203 -- # nvme_devices=2 00:11:51.563 18:00:00 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:11:51.563 18:00:00 -- common/autotest_common.sh@1204 -- # return 0 00:11:51.563 18:00:00 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:11:51.563 18:00:00 -- nvmf/common.sh@511 -- # local dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@510 -- # nvme list 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n2 00:11:51.563 /dev/nvme0n1 ]] 00:11:51.563 18:00:00 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:11:51.563 18:00:00 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:11:51.563 18:00:00 -- nvmf/common.sh@511 -- # local dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@510 -- # nvme list 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ Node == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ --------------------- == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@515 -- # echo /dev/nvme0n2 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- nvmf/common.sh@514 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:11:51.563 18:00:00 -- nvmf/common.sh@515 -- # echo /dev/nvme0n1 00:11:51.563 18:00:00 -- nvmf/common.sh@513 -- # read -r dev _ 00:11:51.563 18:00:00 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:11:51.563 18:00:00 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:11:52.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.942 18:00:01 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:11:52.942 18:00:01 -- common/autotest_common.sh@1215 -- # local i=0 00:11:52.942 18:00:01 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:11:52.942 18:00:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.942 18:00:01 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:11:52.942 18:00:01 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:11:52.942 18:00:01 -- common/autotest_common.sh@1227 -- # return 0 00:11:52.942 18:00:01 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:11:52.942 18:00:01 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:11:52.942 18:00:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:11:52.942 18:00:01 -- common/autotest_common.sh@10 -- # set +x 00:11:52.942 18:00:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:11:52.942 18:00:01 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:11:52.942 18:00:01 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:11:52.942 18:00:01 -- nvmf/common.sh@477 -- # nvmfcleanup 00:11:52.942 18:00:01 -- nvmf/common.sh@117 -- # sync 00:11:52.942 18:00:01 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:11:52.942 18:00:01 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:11:52.942 18:00:01 -- nvmf/common.sh@120 -- # set +e 00:11:52.942 18:00:01 -- nvmf/common.sh@121 -- # for i in {1..20} 00:11:52.942 18:00:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:11:52.942 rmmod nvme_rdma 00:11:52.942 rmmod nvme_fabrics 00:11:52.942 18:00:01 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:11:52.942 18:00:01 -- nvmf/common.sh@124 -- # set -e 00:11:52.942 18:00:01 -- nvmf/common.sh@125 -- # return 0 00:11:52.942 18:00:01 -- nvmf/common.sh@478 -- # '[' -n 916026 ']' 00:11:52.942 18:00:01 -- nvmf/common.sh@479 -- # killprocess 916026 00:11:52.942 18:00:01 -- common/autotest_common.sh@946 -- # '[' -z 916026 ']' 00:11:52.942 18:00:01 -- common/autotest_common.sh@950 -- # kill -0 916026 00:11:52.942 18:00:01 -- common/autotest_common.sh@951 -- # uname 00:11:52.942 18:00:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:11:52.942 18:00:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 916026 00:11:52.942 18:00:01 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:11:52.942 18:00:01 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:11:52.942 18:00:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 916026' 00:11:52.942 killing process with pid 916026 00:11:52.942 18:00:01 -- common/autotest_common.sh@965 -- # kill 916026 00:11:52.942 18:00:01 -- common/autotest_common.sh@970 -- # wait 916026 00:11:52.942 [2024-04-26 18:00:01.937385] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:11:53.199 18:00:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:11:53.199 18:00:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:11:53.199 00:11:53.199 real 0m11.897s 00:11:53.199 user 0m23.759s 00:11:53.199 sys 0m5.207s 00:11:53.199 18:00:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:11:53.199 18:00:02 -- common/autotest_common.sh@10 -- # set +x 00:11:53.199 ************************************ 00:11:53.199 END TEST nvmf_nvme_cli 00:11:53.199 ************************************ 00:11:53.199 18:00:02 -- nvmf/nvmf.sh@40 -- # [[ 0 -eq 1 ]] 00:11:53.199 18:00:02 -- nvmf/nvmf.sh@47 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:11:53.199 18:00:02 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:11:53.199 18:00:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:11:53.199 18:00:02 -- common/autotest_common.sh@10 -- # set +x 00:11:53.199 ************************************ 00:11:53.199 START TEST nvmf_host_management 00:11:53.199 ************************************ 00:11:53.199 18:00:02 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=rdma 00:11:53.457 * Looking for test storage... 00:11:53.457 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:11:53.457 18:00:02 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:11:53.457 18:00:02 -- nvmf/common.sh@7 -- # uname -s 00:11:53.457 18:00:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:53.457 18:00:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:53.457 18:00:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:53.457 18:00:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:53.457 18:00:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:53.457 18:00:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:53.457 18:00:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:53.457 18:00:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:53.457 18:00:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:53.457 18:00:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:53.457 18:00:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:11:53.457 18:00:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:11:53.457 18:00:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:53.457 18:00:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:53.457 18:00:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:53.457 18:00:02 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:11:53.457 18:00:02 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:11:53.457 18:00:02 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:53.457 18:00:02 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:53.457 18:00:02 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:53.457 18:00:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:53.457 18:00:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:53.457 18:00:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:53.457 18:00:02 -- paths/export.sh@5 -- # export PATH 00:11:53.457 18:00:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:53.457 18:00:02 -- nvmf/common.sh@47 -- # : 0 00:11:53.457 18:00:02 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:11:53.457 18:00:02 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:11:53.457 18:00:02 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:11:53.457 18:00:02 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:53.457 18:00:02 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:53.457 18:00:02 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:11:53.457 18:00:02 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:11:53.457 18:00:02 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:11:53.457 18:00:02 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:11:53.457 18:00:02 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:11:53.457 18:00:02 -- target/host_management.sh@105 -- # nvmftestinit 00:11:53.457 18:00:02 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:11:53.457 18:00:02 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:53.457 18:00:02 -- nvmf/common.sh@437 -- # prepare_net_devs 00:11:53.457 18:00:02 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:11:53.457 18:00:02 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:11:53.457 18:00:02 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:53.457 18:00:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:53.457 18:00:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:53.457 18:00:02 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:11:53.457 18:00:02 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:11:53.457 18:00:02 -- nvmf/common.sh@285 -- # xtrace_disable 00:11:53.457 18:00:02 -- common/autotest_common.sh@10 -- # set +x 00:12:00.019 18:00:08 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:00.019 18:00:08 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:00.019 18:00:08 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:00.019 18:00:08 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:00.019 18:00:08 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:00.019 18:00:08 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:00.019 18:00:08 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:00.019 18:00:08 -- nvmf/common.sh@295 -- # net_devs=() 00:12:00.019 18:00:08 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:00.019 18:00:08 -- nvmf/common.sh@296 -- # e810=() 00:12:00.019 18:00:08 -- nvmf/common.sh@296 -- # local -ga e810 00:12:00.019 18:00:08 -- nvmf/common.sh@297 -- # x722=() 00:12:00.019 18:00:08 -- nvmf/common.sh@297 -- # local -ga x722 00:12:00.019 18:00:08 -- nvmf/common.sh@298 -- # mlx=() 00:12:00.019 18:00:08 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:00.019 18:00:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:00.019 18:00:08 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:00.019 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:00.019 18:00:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:00.019 18:00:08 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:00.019 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:00.019 18:00:08 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:00.019 18:00:08 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.019 18:00:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.019 18:00:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:00.019 Found net devices under 0000:18:00.0: mlx_0_0 00:12:00.019 18:00:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.019 18:00:08 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.019 18:00:08 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:00.019 Found net devices under 0000:18:00.1: mlx_0_1 00:12:00.019 18:00:08 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.019 18:00:08 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:00.019 18:00:08 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:00.019 18:00:08 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:00.019 18:00:08 -- nvmf/common.sh@58 -- # uname 00:12:00.019 18:00:08 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:00.019 18:00:08 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:00.019 18:00:08 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:00.019 18:00:08 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:00.019 18:00:08 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:00.019 18:00:08 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:00.019 18:00:08 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:00.019 18:00:08 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:00.019 18:00:08 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:00.019 18:00:08 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:00.019 18:00:08 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:00.019 18:00:08 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:00.019 18:00:08 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:00.019 18:00:08 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:00.019 18:00:08 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:00.019 18:00:08 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:00.019 18:00:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:00.019 18:00:08 -- nvmf/common.sh@105 -- # continue 2 00:12:00.019 18:00:08 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.019 18:00:08 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:00.019 18:00:08 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:00.019 18:00:08 -- nvmf/common.sh@105 -- # continue 2 00:12:00.019 18:00:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:00.019 18:00:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:00.019 18:00:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:00.019 18:00:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:00.019 18:00:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:00.019 18:00:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:00.019 18:00:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:00.019 18:00:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:00.019 18:00:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:00.019 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:00.019 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:00.019 altname enp24s0f0np0 00:12:00.019 altname ens785f0np0 00:12:00.019 inet 192.168.100.8/24 scope global mlx_0_0 00:12:00.019 valid_lft forever preferred_lft forever 00:12:00.019 18:00:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:00.019 18:00:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:00.019 18:00:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:00.019 18:00:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:00.019 18:00:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:00.020 18:00:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:00.020 18:00:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:00.020 18:00:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:00.020 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:00.020 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:00.020 altname enp24s0f1np1 00:12:00.020 altname ens785f1np1 00:12:00.020 inet 192.168.100.9/24 scope global mlx_0_1 00:12:00.020 valid_lft forever preferred_lft forever 00:12:00.020 18:00:09 -- nvmf/common.sh@411 -- # return 0 00:12:00.020 18:00:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:00.020 18:00:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:00.020 18:00:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:00.020 18:00:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:00.020 18:00:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:00.020 18:00:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:00.020 18:00:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:00.020 18:00:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:00.020 18:00:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:00.020 18:00:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:00.020 18:00:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:00.020 18:00:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.020 18:00:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:00.020 18:00:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:00.020 18:00:09 -- nvmf/common.sh@105 -- # continue 2 00:12:00.020 18:00:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:00.020 18:00:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.020 18:00:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:00.020 18:00:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:00.020 18:00:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:00.020 18:00:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:00.020 18:00:09 -- nvmf/common.sh@105 -- # continue 2 00:12:00.020 18:00:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:00.020 18:00:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:00.020 18:00:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:00.020 18:00:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:00.020 18:00:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:00.020 18:00:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:00.020 18:00:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:00.020 18:00:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:00.020 192.168.100.9' 00:12:00.020 18:00:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:00.020 192.168.100.9' 00:12:00.020 18:00:09 -- nvmf/common.sh@446 -- # head -n 1 00:12:00.020 18:00:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:00.020 18:00:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:00.020 192.168.100.9' 00:12:00.020 18:00:09 -- nvmf/common.sh@447 -- # head -n 1 00:12:00.020 18:00:09 -- nvmf/common.sh@447 -- # tail -n +2 00:12:00.020 18:00:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:00.020 18:00:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:00.020 18:00:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:00.020 18:00:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:00.020 18:00:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:00.020 18:00:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:00.020 18:00:09 -- target/host_management.sh@107 -- # run_test nvmf_host_management nvmf_host_management 00:12:00.020 18:00:09 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:12:00.020 18:00:09 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:00.020 18:00:09 -- common/autotest_common.sh@10 -- # set +x 00:12:00.280 ************************************ 00:12:00.280 START TEST nvmf_host_management 00:12:00.280 ************************************ 00:12:00.280 18:00:09 -- common/autotest_common.sh@1121 -- # nvmf_host_management 00:12:00.280 18:00:09 -- target/host_management.sh@69 -- # starttarget 00:12:00.280 18:00:09 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:12:00.280 18:00:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:00.280 18:00:09 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:00.280 18:00:09 -- common/autotest_common.sh@10 -- # set +x 00:12:00.280 18:00:09 -- nvmf/common.sh@470 -- # nvmfpid=920385 00:12:00.280 18:00:09 -- nvmf/common.sh@471 -- # waitforlisten 920385 00:12:00.280 18:00:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:12:00.280 18:00:09 -- common/autotest_common.sh@827 -- # '[' -z 920385 ']' 00:12:00.280 18:00:09 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:00.280 18:00:09 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:00.280 18:00:09 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:00.280 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:00.280 18:00:09 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:00.280 18:00:09 -- common/autotest_common.sh@10 -- # set +x 00:12:00.280 [2024-04-26 18:00:09.369313] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:00.280 [2024-04-26 18:00:09.369375] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:00.280 EAL: No free 2048 kB hugepages reported on node 1 00:12:00.280 [2024-04-26 18:00:09.442000] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:00.538 [2024-04-26 18:00:09.528330] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:00.538 [2024-04-26 18:00:09.528375] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:00.538 [2024-04-26 18:00:09.528385] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:00.538 [2024-04-26 18:00:09.528394] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:00.538 [2024-04-26 18:00:09.528402] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:00.538 [2024-04-26 18:00:09.528507] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:00.538 [2024-04-26 18:00:09.528593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:00.538 [2024-04-26 18:00:09.528692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:00.538 [2024-04-26 18:00:09.528694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:12:01.106 18:00:10 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:01.106 18:00:10 -- common/autotest_common.sh@860 -- # return 0 00:12:01.106 18:00:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:01.106 18:00:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:01.106 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.106 18:00:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:01.106 18:00:10 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:01.106 18:00:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:01.106 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.106 [2024-04-26 18:00:10.253634] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xddc7c0/0xde0cb0) succeed. 00:12:01.106 [2024-04-26 18:00:10.264169] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xddde00/0xe22340) succeed. 00:12:01.365 18:00:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:01.365 18:00:10 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:12:01.365 18:00:10 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:01.365 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.365 18:00:10 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:12:01.365 18:00:10 -- target/host_management.sh@23 -- # cat 00:12:01.365 18:00:10 -- target/host_management.sh@30 -- # rpc_cmd 00:12:01.365 18:00:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:01.365 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.365 Malloc0 00:12:01.365 [2024-04-26 18:00:10.453227] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:01.365 18:00:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:01.365 18:00:10 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:12:01.365 18:00:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:01.365 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.365 18:00:10 -- target/host_management.sh@73 -- # perfpid=920607 00:12:01.365 18:00:10 -- target/host_management.sh@74 -- # waitforlisten 920607 /var/tmp/bdevperf.sock 00:12:01.365 18:00:10 -- common/autotest_common.sh@827 -- # '[' -z 920607 ']' 00:12:01.365 18:00:10 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:01.365 18:00:10 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:01.365 18:00:10 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:12:01.365 18:00:10 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:12:01.366 18:00:10 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:01.366 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:01.366 18:00:10 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:01.366 18:00:10 -- nvmf/common.sh@521 -- # config=() 00:12:01.366 18:00:10 -- common/autotest_common.sh@10 -- # set +x 00:12:01.366 18:00:10 -- nvmf/common.sh@521 -- # local subsystem config 00:12:01.366 18:00:10 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:01.366 18:00:10 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:01.366 { 00:12:01.366 "params": { 00:12:01.366 "name": "Nvme$subsystem", 00:12:01.366 "trtype": "$TEST_TRANSPORT", 00:12:01.366 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:01.366 "adrfam": "ipv4", 00:12:01.366 "trsvcid": "$NVMF_PORT", 00:12:01.366 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:01.366 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:01.366 "hdgst": ${hdgst:-false}, 00:12:01.366 "ddgst": ${ddgst:-false} 00:12:01.366 }, 00:12:01.366 "method": "bdev_nvme_attach_controller" 00:12:01.366 } 00:12:01.366 EOF 00:12:01.366 )") 00:12:01.366 18:00:10 -- nvmf/common.sh@543 -- # cat 00:12:01.366 18:00:10 -- nvmf/common.sh@545 -- # jq . 00:12:01.366 18:00:10 -- nvmf/common.sh@546 -- # IFS=, 00:12:01.366 18:00:10 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:01.366 "params": { 00:12:01.366 "name": "Nvme0", 00:12:01.366 "trtype": "rdma", 00:12:01.366 "traddr": "192.168.100.8", 00:12:01.366 "adrfam": "ipv4", 00:12:01.366 "trsvcid": "4420", 00:12:01.366 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:01.366 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:12:01.366 "hdgst": false, 00:12:01.366 "ddgst": false 00:12:01.366 }, 00:12:01.366 "method": "bdev_nvme_attach_controller" 00:12:01.366 }' 00:12:01.366 [2024-04-26 18:00:10.557024] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:01.366 [2024-04-26 18:00:10.557083] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid920607 ] 00:12:01.625 EAL: No free 2048 kB hugepages reported on node 1 00:12:01.625 [2024-04-26 18:00:10.632244] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:01.625 [2024-04-26 18:00:10.712878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:01.884 Running I/O for 10 seconds... 00:12:02.452 18:00:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:02.452 18:00:11 -- common/autotest_common.sh@860 -- # return 0 00:12:02.452 18:00:11 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:12:02.452 18:00:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.452 18:00:11 -- common/autotest_common.sh@10 -- # set +x 00:12:02.452 18:00:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.452 18:00:11 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:02.452 18:00:11 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:12:02.452 18:00:11 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:12:02.452 18:00:11 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:12:02.452 18:00:11 -- target/host_management.sh@52 -- # local ret=1 00:12:02.452 18:00:11 -- target/host_management.sh@53 -- # local i 00:12:02.452 18:00:11 -- target/host_management.sh@54 -- # (( i = 10 )) 00:12:02.452 18:00:11 -- target/host_management.sh@54 -- # (( i != 0 )) 00:12:02.452 18:00:11 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:12:02.452 18:00:11 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:12:02.452 18:00:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.452 18:00:11 -- common/autotest_common.sh@10 -- # set +x 00:12:02.452 18:00:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.452 18:00:11 -- target/host_management.sh@55 -- # read_io_count=1516 00:12:02.452 18:00:11 -- target/host_management.sh@58 -- # '[' 1516 -ge 100 ']' 00:12:02.452 18:00:11 -- target/host_management.sh@59 -- # ret=0 00:12:02.452 18:00:11 -- target/host_management.sh@60 -- # break 00:12:02.452 18:00:11 -- target/host_management.sh@64 -- # return 0 00:12:02.452 18:00:11 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:12:02.452 18:00:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.452 18:00:11 -- common/autotest_common.sh@10 -- # set +x 00:12:02.452 18:00:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.452 18:00:11 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:12:02.452 18:00:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:12:02.452 18:00:11 -- common/autotest_common.sh@10 -- # set +x 00:12:02.452 18:00:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:12:02.452 18:00:11 -- target/host_management.sh@87 -- # sleep 1 00:12:03.390 [2024-04-26 18:00:12.463743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:81920 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138da900 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:82048 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ca880 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82176 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138ba800 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:82304 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000138aa780 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:82432 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001389a700 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:82560 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001388a680 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:82688 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001387a600 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:82816 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001386a580 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:82944 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001385a500 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:83072 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001384a480 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.463990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:83200 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001383a400 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.463999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:83328 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001382a380 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.464020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:83456 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001381a300 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.464040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:83584 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001380a280 len:0x10000 key:0x182500 00:12:03.390 [2024-04-26 18:00:12.464060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:83712 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192d1e80 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:83840 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192c1e00 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:83968 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192b1d80 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:84096 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000192a1d00 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:84224 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019291c80 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:84352 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019281c00 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:84480 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019271b80 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:84608 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019261b00 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:84736 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019251a80 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:84864 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019241a00 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:84992 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019231980 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:85120 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019221900 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:85248 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019211880 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:85376 len:128 SGL KEYED DATA BLOCK ADDRESS 0x200019201800 len:0x10000 key:0x182800 00:12:03.390 [2024-04-26 18:00:12.464350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:85504 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190eff80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:85632 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190dff00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:85760 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190cfe80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:85888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190bfe00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:86016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x2000190afd80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:86144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001909fd00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:86272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001908fc80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:86400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001907fc00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:86528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001906fb80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:86656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001905fb00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:86784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001904fa80 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:86912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001903fa00 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:87040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001902f980 len:0x10000 key:0x182700 00:12:03.390 [2024-04-26 18:00:12.464615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:78976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d4be000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:79104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d4df000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:79232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ce8e000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:79360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000ceaf000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:79488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c85e000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:79616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c87f000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:79744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c22e000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:79872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000c24f000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:80000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000b6f7000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:80128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8ff000 len:0x10000 key:0x182400 00:12:03.390 [2024-04-26 18:00:12.464823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.390 [2024-04-26 18:00:12.464834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:80256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8de000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:80384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d8bd000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:80512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d89c000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:80640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d87b000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:80768 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d85a000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:80896 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d839000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:81024 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7d6000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:81152 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d7b5000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.464987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.464998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:81280 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d794000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.465007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.465017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:81408 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d773000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.465027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.465038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:81536 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d752000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.465047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.465058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:81664 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d731000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.465067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.465078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:81792 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20000d710000 len:0x10000 key:0x182400 00:12:03.391 [2024-04-26 18:00:12.465088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32764 cdw0:3eff200 sqhd:8e00 p:0 m:0 dnr:0 00:12:03.391 [2024-04-26 18:00:12.467038] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192015c0 was disconnected and freed. reset controller. 00:12:03.391 [2024-04-26 18:00:12.467960] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:12:03.391 task offset: 81920 on job bdev=Nvme0n1 fails 00:12:03.391 00:12:03.391 Latency(us) 00:12:03.391 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:03.391 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:12:03.391 Job: Nvme0n1 ended in about 1.57 seconds with error 00:12:03.391 Verification LBA range: start 0x0 length 0x400 00:12:03.391 Nvme0n1 : 1.57 1045.48 65.34 40.77 0.00 58362.97 2165.54 1021221.84 00:12:03.391 =================================================================================================================== 00:12:03.391 Total : 1045.48 65.34 40.77 0.00 58362.97 2165.54 1021221.84 00:12:03.391 [2024-04-26 18:00:12.469731] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:12:03.391 18:00:12 -- target/host_management.sh@91 -- # kill -9 920607 00:12:03.391 18:00:12 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:12:03.391 18:00:12 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:12:03.391 18:00:12 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:12:03.391 18:00:12 -- nvmf/common.sh@521 -- # config=() 00:12:03.391 18:00:12 -- nvmf/common.sh@521 -- # local subsystem config 00:12:03.391 18:00:12 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:12:03.391 18:00:12 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:12:03.391 { 00:12:03.391 "params": { 00:12:03.391 "name": "Nvme$subsystem", 00:12:03.391 "trtype": "$TEST_TRANSPORT", 00:12:03.391 "traddr": "$NVMF_FIRST_TARGET_IP", 00:12:03.391 "adrfam": "ipv4", 00:12:03.391 "trsvcid": "$NVMF_PORT", 00:12:03.391 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:12:03.391 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:12:03.391 "hdgst": ${hdgst:-false}, 00:12:03.391 "ddgst": ${ddgst:-false} 00:12:03.391 }, 00:12:03.391 "method": "bdev_nvme_attach_controller" 00:12:03.391 } 00:12:03.391 EOF 00:12:03.391 )") 00:12:03.391 18:00:12 -- nvmf/common.sh@543 -- # cat 00:12:03.391 18:00:12 -- nvmf/common.sh@545 -- # jq . 00:12:03.391 18:00:12 -- nvmf/common.sh@546 -- # IFS=, 00:12:03.391 18:00:12 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:12:03.391 "params": { 00:12:03.391 "name": "Nvme0", 00:12:03.391 "trtype": "rdma", 00:12:03.391 "traddr": "192.168.100.8", 00:12:03.391 "adrfam": "ipv4", 00:12:03.391 "trsvcid": "4420", 00:12:03.391 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:03.391 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:12:03.391 "hdgst": false, 00:12:03.391 "ddgst": false 00:12:03.391 }, 00:12:03.391 "method": "bdev_nvme_attach_controller" 00:12:03.391 }' 00:12:03.391 [2024-04-26 18:00:12.521272] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:03.391 [2024-04-26 18:00:12.521326] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid920815 ] 00:12:03.391 EAL: No free 2048 kB hugepages reported on node 1 00:12:03.650 [2024-04-26 18:00:12.591994] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:03.650 [2024-04-26 18:00:12.673100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:03.909 Running I/O for 1 seconds... 00:12:04.846 00:12:04.846 Latency(us) 00:12:04.846 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:04.846 Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:12:04.846 Verification LBA range: start 0x0 length 0x400 00:12:04.846 Nvme0n1 : 1.01 3029.93 189.37 0.00 0.00 20688.66 676.73 42854.85 00:12:04.846 =================================================================================================================== 00:12:04.846 Total : 3029.93 189.37 0.00 0.00 20688.66 676.73 42854.85 00:12:05.106 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 68: 920607 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "0") -q 64 -o 65536 -w verify -t 10 "${NO_HUGE[@]}" 00:12:05.106 18:00:14 -- target/host_management.sh@102 -- # stoptarget 00:12:05.106 18:00:14 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:12:05.107 18:00:14 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:12:05.107 18:00:14 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:12:05.107 18:00:14 -- target/host_management.sh@40 -- # nvmftestfini 00:12:05.107 18:00:14 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:05.107 18:00:14 -- nvmf/common.sh@117 -- # sync 00:12:05.107 18:00:14 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:05.107 18:00:14 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:05.107 18:00:14 -- nvmf/common.sh@120 -- # set +e 00:12:05.107 18:00:14 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:05.107 18:00:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:05.107 rmmod nvme_rdma 00:12:05.107 rmmod nvme_fabrics 00:12:05.107 18:00:14 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:05.107 18:00:14 -- nvmf/common.sh@124 -- # set -e 00:12:05.107 18:00:14 -- nvmf/common.sh@125 -- # return 0 00:12:05.107 18:00:14 -- nvmf/common.sh@478 -- # '[' -n 920385 ']' 00:12:05.107 18:00:14 -- nvmf/common.sh@479 -- # killprocess 920385 00:12:05.107 18:00:14 -- common/autotest_common.sh@946 -- # '[' -z 920385 ']' 00:12:05.107 18:00:14 -- common/autotest_common.sh@950 -- # kill -0 920385 00:12:05.107 18:00:14 -- common/autotest_common.sh@951 -- # uname 00:12:05.107 18:00:14 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:05.107 18:00:14 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 920385 00:12:05.107 18:00:14 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:12:05.107 18:00:14 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:12:05.107 18:00:14 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 920385' 00:12:05.107 killing process with pid 920385 00:12:05.107 18:00:14 -- common/autotest_common.sh@965 -- # kill 920385 00:12:05.107 18:00:14 -- common/autotest_common.sh@970 -- # wait 920385 00:12:05.364 [2024-04-26 18:00:14.318259] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:05.364 [2024-04-26 18:00:14.550640] app.c: 630:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:12:05.623 18:00:14 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:05.623 18:00:14 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:05.623 00:12:05.623 real 0m5.264s 00:12:05.623 user 0m23.280s 00:12:05.623 sys 0m1.076s 00:12:05.623 18:00:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:05.623 18:00:14 -- common/autotest_common.sh@10 -- # set +x 00:12:05.623 ************************************ 00:12:05.623 END TEST nvmf_host_management 00:12:05.623 ************************************ 00:12:05.623 18:00:14 -- target/host_management.sh@109 -- # trap - SIGINT SIGTERM EXIT 00:12:05.623 00:12:05.623 real 0m12.249s 00:12:05.623 user 0m25.257s 00:12:05.623 sys 0m6.287s 00:12:05.623 18:00:14 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:05.623 18:00:14 -- common/autotest_common.sh@10 -- # set +x 00:12:05.623 ************************************ 00:12:05.623 END TEST nvmf_host_management 00:12:05.623 ************************************ 00:12:05.623 18:00:14 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:12:05.623 18:00:14 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:05.623 18:00:14 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:05.623 18:00:14 -- common/autotest_common.sh@10 -- # set +x 00:12:05.883 ************************************ 00:12:05.883 START TEST nvmf_lvol 00:12:05.883 ************************************ 00:12:05.883 18:00:14 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=rdma 00:12:05.883 * Looking for test storage... 00:12:05.883 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:05.883 18:00:14 -- nvmf/common.sh@7 -- # uname -s 00:12:05.883 18:00:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:05.883 18:00:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:05.883 18:00:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:05.883 18:00:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:05.883 18:00:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:05.883 18:00:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:05.883 18:00:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:05.883 18:00:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:05.883 18:00:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:05.883 18:00:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:05.883 18:00:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:05.883 18:00:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:05.883 18:00:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:05.883 18:00:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:05.883 18:00:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:05.883 18:00:14 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:05.883 18:00:14 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:05.883 18:00:14 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:05.883 18:00:14 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:05.883 18:00:14 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:05.883 18:00:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.883 18:00:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.883 18:00:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.883 18:00:14 -- paths/export.sh@5 -- # export PATH 00:12:05.883 18:00:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:05.883 18:00:14 -- nvmf/common.sh@47 -- # : 0 00:12:05.883 18:00:14 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:05.883 18:00:14 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:05.883 18:00:14 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:05.883 18:00:14 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:05.883 18:00:14 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:05.883 18:00:14 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:05.883 18:00:14 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:05.883 18:00:14 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:05.883 18:00:14 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:12:05.883 18:00:14 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:05.883 18:00:14 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:05.883 18:00:14 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:05.883 18:00:14 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:05.883 18:00:14 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:05.883 18:00:14 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:05.883 18:00:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:05.883 18:00:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:05.883 18:00:14 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:05.883 18:00:14 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:05.883 18:00:14 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:05.883 18:00:14 -- common/autotest_common.sh@10 -- # set +x 00:12:11.154 18:00:20 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:11.154 18:00:20 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:11.154 18:00:20 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:11.154 18:00:20 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:11.154 18:00:20 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:11.154 18:00:20 -- nvmf/common.sh@295 -- # net_devs=() 00:12:11.154 18:00:20 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@296 -- # e810=() 00:12:11.154 18:00:20 -- nvmf/common.sh@296 -- # local -ga e810 00:12:11.154 18:00:20 -- nvmf/common.sh@297 -- # x722=() 00:12:11.154 18:00:20 -- nvmf/common.sh@297 -- # local -ga x722 00:12:11.154 18:00:20 -- nvmf/common.sh@298 -- # mlx=() 00:12:11.154 18:00:20 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:11.154 18:00:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:11.154 18:00:20 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:11.154 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:11.154 18:00:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.154 18:00:20 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:11.154 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:11.154 18:00:20 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:11.154 18:00:20 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.154 18:00:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.154 18:00:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:11.154 Found net devices under 0000:18:00.0: mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:11.154 18:00:20 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:11.154 18:00:20 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:11.154 Found net devices under 0000:18:00.1: mlx_0_1 00:12:11.154 18:00:20 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:11.154 18:00:20 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:11.154 18:00:20 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:11.154 18:00:20 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:11.154 18:00:20 -- nvmf/common.sh@58 -- # uname 00:12:11.154 18:00:20 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:11.154 18:00:20 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:11.154 18:00:20 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:11.154 18:00:20 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:11.154 18:00:20 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:11.154 18:00:20 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:11.154 18:00:20 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:11.154 18:00:20 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:11.154 18:00:20 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:11.154 18:00:20 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:11.154 18:00:20 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:11.154 18:00:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.154 18:00:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.154 18:00:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@105 -- # continue 2 00:12:11.154 18:00:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.154 18:00:20 -- nvmf/common.sh@105 -- # continue 2 00:12:11.154 18:00:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.154 18:00:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.154 18:00:20 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:11.154 18:00:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:11.154 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.154 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:11.154 altname enp24s0f0np0 00:12:11.154 altname ens785f0np0 00:12:11.154 inet 192.168.100.8/24 scope global mlx_0_0 00:12:11.154 valid_lft forever preferred_lft forever 00:12:11.154 18:00:20 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:11.154 18:00:20 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:11.154 18:00:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.154 18:00:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.154 18:00:20 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:11.154 18:00:20 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:11.154 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:11.154 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:11.154 altname enp24s0f1np1 00:12:11.154 altname ens785f1np1 00:12:11.154 inet 192.168.100.9/24 scope global mlx_0_1 00:12:11.154 valid_lft forever preferred_lft forever 00:12:11.154 18:00:20 -- nvmf/common.sh@411 -- # return 0 00:12:11.154 18:00:20 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:11.154 18:00:20 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:11.154 18:00:20 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:11.154 18:00:20 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:11.154 18:00:20 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:11.154 18:00:20 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:11.154 18:00:20 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:11.154 18:00:20 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:11.154 18:00:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:11.154 18:00:20 -- nvmf/common.sh@105 -- # continue 2 00:12:11.154 18:00:20 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:11.154 18:00:20 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:11.154 18:00:20 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:11.155 18:00:20 -- nvmf/common.sh@105 -- # continue 2 00:12:11.155 18:00:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.155 18:00:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:11.155 18:00:20 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.155 18:00:20 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:11.155 18:00:20 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:11.155 18:00:20 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:11.155 18:00:20 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:11.155 18:00:20 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:11.155 192.168.100.9' 00:12:11.155 18:00:20 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:11.155 192.168.100.9' 00:12:11.155 18:00:20 -- nvmf/common.sh@446 -- # head -n 1 00:12:11.155 18:00:20 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:11.155 18:00:20 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:11.155 192.168.100.9' 00:12:11.155 18:00:20 -- nvmf/common.sh@447 -- # head -n 1 00:12:11.155 18:00:20 -- nvmf/common.sh@447 -- # tail -n +2 00:12:11.155 18:00:20 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:11.155 18:00:20 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:11.155 18:00:20 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:11.155 18:00:20 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:11.155 18:00:20 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:11.155 18:00:20 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:11.155 18:00:20 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:12:11.155 18:00:20 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:11.155 18:00:20 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:11.155 18:00:20 -- common/autotest_common.sh@10 -- # set +x 00:12:11.155 18:00:20 -- nvmf/common.sh@470 -- # nvmfpid=923912 00:12:11.155 18:00:20 -- nvmf/common.sh@471 -- # waitforlisten 923912 00:12:11.155 18:00:20 -- common/autotest_common.sh@827 -- # '[' -z 923912 ']' 00:12:11.155 18:00:20 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:11.155 18:00:20 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:11.155 18:00:20 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:11.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:11.155 18:00:20 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:11.155 18:00:20 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:12:11.155 18:00:20 -- common/autotest_common.sh@10 -- # set +x 00:12:11.155 [2024-04-26 18:00:20.329462] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:11.155 [2024-04-26 18:00:20.329525] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:11.414 EAL: No free 2048 kB hugepages reported on node 1 00:12:11.414 [2024-04-26 18:00:20.402157] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:11.414 [2024-04-26 18:00:20.490789] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:11.414 [2024-04-26 18:00:20.490827] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:11.414 [2024-04-26 18:00:20.490838] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:11.414 [2024-04-26 18:00:20.490862] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:11.414 [2024-04-26 18:00:20.490870] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:11.414 [2024-04-26 18:00:20.490921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:11.414 [2024-04-26 18:00:20.491005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:11.414 [2024-04-26 18:00:20.491008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:11.980 18:00:21 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:11.980 18:00:21 -- common/autotest_common.sh@860 -- # return 0 00:12:11.980 18:00:21 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:11.980 18:00:21 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:11.980 18:00:21 -- common/autotest_common.sh@10 -- # set +x 00:12:12.238 18:00:21 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:12.238 18:00:21 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:12.238 [2024-04-26 18:00:21.372658] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1201a30/0x1205f20) succeed. 00:12:12.238 [2024-04-26 18:00:21.383003] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1202fd0/0x12475b0) succeed. 00:12:12.504 18:00:21 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:12.763 18:00:21 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:12:12.763 18:00:21 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:12:12.763 18:00:21 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:12:12.763 18:00:21 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:12:13.022 18:00:22 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:12:13.280 18:00:22 -- target/nvmf_lvol.sh@29 -- # lvs=0ac30dbd-6a35-477d-8314-5bb13cb6851f 00:12:13.280 18:00:22 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0ac30dbd-6a35-477d-8314-5bb13cb6851f lvol 20 00:12:13.280 18:00:22 -- target/nvmf_lvol.sh@32 -- # lvol=a151a3d9-f833-4a54-8ff7-e095fdf12aba 00:12:13.280 18:00:22 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:13.539 18:00:22 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a151a3d9-f833-4a54-8ff7-e095fdf12aba 00:12:13.799 18:00:22 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:14.057 [2024-04-26 18:00:22.997919] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:14.057 18:00:23 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:14.057 18:00:23 -- target/nvmf_lvol.sh@42 -- # perf_pid=924314 00:12:14.057 18:00:23 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:12:14.057 18:00:23 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:12:14.314 EAL: No free 2048 kB hugepages reported on node 1 00:12:15.251 18:00:24 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot a151a3d9-f833-4a54-8ff7-e095fdf12aba MY_SNAPSHOT 00:12:15.251 18:00:24 -- target/nvmf_lvol.sh@47 -- # snapshot=0d05b23e-c9f5-45e2-87fb-b0cd313e1875 00:12:15.251 18:00:24 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize a151a3d9-f833-4a54-8ff7-e095fdf12aba 30 00:12:15.510 18:00:24 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 0d05b23e-c9f5-45e2-87fb-b0cd313e1875 MY_CLONE 00:12:15.769 18:00:24 -- target/nvmf_lvol.sh@49 -- # clone=c0e3b8dd-2a53-4799-80ce-be33b335059a 00:12:15.769 18:00:24 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate c0e3b8dd-2a53-4799-80ce-be33b335059a 00:12:16.029 18:00:24 -- target/nvmf_lvol.sh@53 -- # wait 924314 00:12:26.169 Initializing NVMe Controllers 00:12:26.169 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:12:26.169 Controller IO queue size 128, less than required. 00:12:26.169 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:12:26.169 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:12:26.169 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:12:26.169 Initialization complete. Launching workers. 00:12:26.169 ======================================================== 00:12:26.169 Latency(us) 00:12:26.169 Device Information : IOPS MiB/s Average min max 00:12:26.169 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 16500.63 64.46 7759.49 2657.39 38729.77 00:12:26.169 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 16618.83 64.92 7703.41 3650.22 47407.06 00:12:26.169 ======================================================== 00:12:26.169 Total : 33119.46 129.37 7731.35 2657.39 47407.06 00:12:26.169 00:12:26.169 18:00:34 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:26.169 18:00:34 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a151a3d9-f833-4a54-8ff7-e095fdf12aba 00:12:26.169 18:00:34 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 0ac30dbd-6a35-477d-8314-5bb13cb6851f 00:12:26.169 18:00:35 -- target/nvmf_lvol.sh@60 -- # rm -f 00:12:26.169 18:00:35 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:12:26.169 18:00:35 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:12:26.169 18:00:35 -- nvmf/common.sh@477 -- # nvmfcleanup 00:12:26.169 18:00:35 -- nvmf/common.sh@117 -- # sync 00:12:26.169 18:00:35 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:12:26.169 18:00:35 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:12:26.169 18:00:35 -- nvmf/common.sh@120 -- # set +e 00:12:26.169 18:00:35 -- nvmf/common.sh@121 -- # for i in {1..20} 00:12:26.169 18:00:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:12:26.169 rmmod nvme_rdma 00:12:26.169 rmmod nvme_fabrics 00:12:26.169 18:00:35 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:12:26.169 18:00:35 -- nvmf/common.sh@124 -- # set -e 00:12:26.169 18:00:35 -- nvmf/common.sh@125 -- # return 0 00:12:26.169 18:00:35 -- nvmf/common.sh@478 -- # '[' -n 923912 ']' 00:12:26.169 18:00:35 -- nvmf/common.sh@479 -- # killprocess 923912 00:12:26.169 18:00:35 -- common/autotest_common.sh@946 -- # '[' -z 923912 ']' 00:12:26.169 18:00:35 -- common/autotest_common.sh@950 -- # kill -0 923912 00:12:26.169 18:00:35 -- common/autotest_common.sh@951 -- # uname 00:12:26.169 18:00:35 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:26.169 18:00:35 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 923912 00:12:26.169 18:00:35 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:12:26.169 18:00:35 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:12:26.169 18:00:35 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 923912' 00:12:26.169 killing process with pid 923912 00:12:26.169 18:00:35 -- common/autotest_common.sh@965 -- # kill 923912 00:12:26.169 18:00:35 -- common/autotest_common.sh@970 -- # wait 923912 00:12:26.428 [2024-04-26 18:00:35.365112] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:12:26.428 18:00:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:12:26.428 18:00:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:12:26.428 00:12:26.428 real 0m20.781s 00:12:26.428 user 1m11.060s 00:12:26.428 sys 0m5.411s 00:12:26.428 18:00:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:26.428 18:00:35 -- common/autotest_common.sh@10 -- # set +x 00:12:26.428 ************************************ 00:12:26.428 END TEST nvmf_lvol 00:12:26.428 ************************************ 00:12:26.687 18:00:35 -- nvmf/nvmf.sh@49 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:12:26.687 18:00:35 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:26.687 18:00:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:26.687 18:00:35 -- common/autotest_common.sh@10 -- # set +x 00:12:26.687 ************************************ 00:12:26.687 START TEST nvmf_lvs_grow 00:12:26.687 ************************************ 00:12:26.687 18:00:35 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=rdma 00:12:26.687 * Looking for test storage... 00:12:26.946 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:12:26.946 18:00:35 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:12:26.946 18:00:35 -- nvmf/common.sh@7 -- # uname -s 00:12:26.946 18:00:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:26.946 18:00:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:26.946 18:00:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:26.946 18:00:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:26.946 18:00:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:26.946 18:00:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:26.946 18:00:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:26.946 18:00:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:26.946 18:00:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:26.946 18:00:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:26.946 18:00:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:12:26.946 18:00:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:12:26.946 18:00:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:26.946 18:00:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:26.946 18:00:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:26.946 18:00:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:12:26.946 18:00:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:12:26.946 18:00:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:26.946 18:00:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:26.946 18:00:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:26.946 18:00:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:26.946 18:00:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:26.946 18:00:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:26.946 18:00:35 -- paths/export.sh@5 -- # export PATH 00:12:26.946 18:00:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:26.946 18:00:35 -- nvmf/common.sh@47 -- # : 0 00:12:26.946 18:00:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:12:26.946 18:00:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:12:26.946 18:00:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:12:26.946 18:00:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:26.946 18:00:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:26.946 18:00:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:12:26.946 18:00:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:12:26.946 18:00:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:12:26.946 18:00:35 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:26.946 18:00:35 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:12:26.946 18:00:35 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:12:26.946 18:00:35 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:12:26.946 18:00:35 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:26.946 18:00:35 -- nvmf/common.sh@437 -- # prepare_net_devs 00:12:26.946 18:00:35 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:12:26.946 18:00:35 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:12:26.946 18:00:35 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:26.946 18:00:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:26.946 18:00:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:26.946 18:00:35 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:12:26.946 18:00:35 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:12:26.946 18:00:35 -- nvmf/common.sh@285 -- # xtrace_disable 00:12:26.946 18:00:35 -- common/autotest_common.sh@10 -- # set +x 00:12:33.535 18:00:41 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:33.535 18:00:41 -- nvmf/common.sh@291 -- # pci_devs=() 00:12:33.535 18:00:41 -- nvmf/common.sh@291 -- # local -a pci_devs 00:12:33.535 18:00:41 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:12:33.535 18:00:41 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:12:33.535 18:00:41 -- nvmf/common.sh@293 -- # pci_drivers=() 00:12:33.535 18:00:41 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:12:33.535 18:00:41 -- nvmf/common.sh@295 -- # net_devs=() 00:12:33.535 18:00:41 -- nvmf/common.sh@295 -- # local -ga net_devs 00:12:33.535 18:00:41 -- nvmf/common.sh@296 -- # e810=() 00:12:33.535 18:00:41 -- nvmf/common.sh@296 -- # local -ga e810 00:12:33.535 18:00:41 -- nvmf/common.sh@297 -- # x722=() 00:12:33.535 18:00:41 -- nvmf/common.sh@297 -- # local -ga x722 00:12:33.535 18:00:41 -- nvmf/common.sh@298 -- # mlx=() 00:12:33.535 18:00:41 -- nvmf/common.sh@298 -- # local -ga mlx 00:12:33.535 18:00:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:33.535 18:00:41 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:12:33.535 18:00:41 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:12:33.535 18:00:41 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:12:33.535 18:00:41 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:12:33.536 18:00:41 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:12:33.536 18:00:41 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:12:33.536 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:12:33.536 18:00:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:33.536 18:00:41 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:12:33.536 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:12:33.536 18:00:41 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:12:33.536 18:00:41 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.536 18:00:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.536 18:00:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:12:33.536 Found net devices under 0000:18:00.0: mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.536 18:00:41 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:33.536 18:00:41 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:33.536 18:00:41 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:12:33.536 Found net devices under 0000:18:00.1: mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:12:33.536 18:00:41 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@403 -- # is_hw=yes 00:12:33.536 18:00:41 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@409 -- # rdma_device_init 00:12:33.536 18:00:41 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:12:33.536 18:00:41 -- nvmf/common.sh@58 -- # uname 00:12:33.536 18:00:41 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:12:33.536 18:00:41 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:12:33.536 18:00:41 -- nvmf/common.sh@63 -- # modprobe ib_core 00:12:33.536 18:00:41 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:12:33.536 18:00:41 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:12:33.536 18:00:41 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:12:33.536 18:00:41 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:12:33.536 18:00:41 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:12:33.536 18:00:41 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:12:33.536 18:00:41 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:12:33.536 18:00:41 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:12:33.536 18:00:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:33.536 18:00:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:33.536 18:00:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:33.536 18:00:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:33.536 18:00:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@105 -- # continue 2 00:12:33.536 18:00:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@105 -- # continue 2 00:12:33.536 18:00:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:33.536 18:00:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:33.536 18:00:41 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:12:33.536 18:00:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:12:33.536 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:33.536 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:12:33.536 altname enp24s0f0np0 00:12:33.536 altname ens785f0np0 00:12:33.536 inet 192.168.100.8/24 scope global mlx_0_0 00:12:33.536 valid_lft forever preferred_lft forever 00:12:33.536 18:00:41 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:12:33.536 18:00:41 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:33.536 18:00:41 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:12:33.536 18:00:41 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:12:33.536 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:12:33.536 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:12:33.536 altname enp24s0f1np1 00:12:33.536 altname ens785f1np1 00:12:33.536 inet 192.168.100.9/24 scope global mlx_0_1 00:12:33.536 valid_lft forever preferred_lft forever 00:12:33.536 18:00:41 -- nvmf/common.sh@411 -- # return 0 00:12:33.536 18:00:41 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:12:33.536 18:00:41 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:12:33.536 18:00:41 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:12:33.536 18:00:41 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:12:33.536 18:00:41 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:12:33.536 18:00:41 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:12:33.536 18:00:41 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:12:33.536 18:00:41 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:12:33.536 18:00:41 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:12:33.536 18:00:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@105 -- # continue 2 00:12:33.536 18:00:41 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:12:33.536 18:00:41 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:12:33.536 18:00:41 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@105 -- # continue 2 00:12:33.536 18:00:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:33.536 18:00:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:33.536 18:00:41 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:12:33.536 18:00:41 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:12:33.536 18:00:41 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:12:33.536 18:00:41 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:12:33.536 192.168.100.9' 00:12:33.536 18:00:41 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:12:33.536 192.168.100.9' 00:12:33.536 18:00:41 -- nvmf/common.sh@446 -- # head -n 1 00:12:33.536 18:00:41 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:12:33.536 18:00:41 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:12:33.536 192.168.100.9' 00:12:33.536 18:00:41 -- nvmf/common.sh@447 -- # tail -n +2 00:12:33.536 18:00:41 -- nvmf/common.sh@447 -- # head -n 1 00:12:33.536 18:00:41 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:12:33.536 18:00:41 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:12:33.536 18:00:41 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:12:33.536 18:00:41 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:12:33.536 18:00:41 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:12:33.536 18:00:41 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:12:33.536 18:00:41 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:12:33.537 18:00:41 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:12:33.537 18:00:41 -- common/autotest_common.sh@720 -- # xtrace_disable 00:12:33.537 18:00:41 -- common/autotest_common.sh@10 -- # set +x 00:12:33.537 18:00:41 -- nvmf/common.sh@470 -- # nvmfpid=928770 00:12:33.537 18:00:41 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:12:33.537 18:00:41 -- nvmf/common.sh@471 -- # waitforlisten 928770 00:12:33.537 18:00:41 -- common/autotest_common.sh@827 -- # '[' -z 928770 ']' 00:12:33.537 18:00:41 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:33.537 18:00:41 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:33.537 18:00:41 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:33.537 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:33.537 18:00:41 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:33.537 18:00:41 -- common/autotest_common.sh@10 -- # set +x 00:12:33.537 [2024-04-26 18:00:42.036416] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:33.537 [2024-04-26 18:00:42.036480] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:33.537 EAL: No free 2048 kB hugepages reported on node 1 00:12:33.537 [2024-04-26 18:00:42.109721] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:33.537 [2024-04-26 18:00:42.198460] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:33.537 [2024-04-26 18:00:42.198500] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:33.537 [2024-04-26 18:00:42.198509] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:12:33.537 [2024-04-26 18:00:42.198534] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:12:33.537 [2024-04-26 18:00:42.198541] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:33.537 [2024-04-26 18:00:42.198569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:33.796 18:00:42 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:33.796 18:00:42 -- common/autotest_common.sh@860 -- # return 0 00:12:33.796 18:00:42 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:12:33.796 18:00:42 -- common/autotest_common.sh@726 -- # xtrace_disable 00:12:33.796 18:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:33.796 18:00:42 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:33.796 18:00:42 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:12:34.055 [2024-04-26 18:00:43.052207] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xdc93e0/0xdcd8d0) succeed. 00:12:34.055 [2024-04-26 18:00:43.061171] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xdca8e0/0xe0ef60) succeed. 00:12:34.055 18:00:43 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:12:34.055 18:00:43 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:12:34.055 18:00:43 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:34.055 18:00:43 -- common/autotest_common.sh@10 -- # set +x 00:12:34.313 ************************************ 00:12:34.313 START TEST lvs_grow_clean 00:12:34.313 ************************************ 00:12:34.313 18:00:43 -- common/autotest_common.sh@1121 -- # lvs_grow 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:34.313 18:00:43 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:34.571 18:00:43 -- target/nvmf_lvs_grow.sh@28 -- # lvs=db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:34.571 18:00:43 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:34.571 18:00:43 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u db45297a-edcd-492b-9a3b-76b112e89e0f lvol 150 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@33 -- # lvol=69913a66-2212-428b-9977-d6f297849522 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:34.829 18:00:43 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:35.087 [2024-04-26 18:00:44.138024] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:35.087 [2024-04-26 18:00:44.138094] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:35.087 true 00:12:35.087 18:00:44 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:35.087 18:00:44 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:35.347 18:00:44 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:35.347 18:00:44 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:35.347 18:00:44 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 69913a66-2212-428b-9977-d6f297849522 00:12:35.606 18:00:44 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:35.606 [2024-04-26 18:00:44.764063] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:12:35.606 18:00:44 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:35.865 18:00:44 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=929275 00:12:35.865 18:00:44 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:35.865 18:00:44 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:35.865 18:00:44 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 929275 /var/tmp/bdevperf.sock 00:12:35.865 18:00:44 -- common/autotest_common.sh@827 -- # '[' -z 929275 ']' 00:12:35.865 18:00:44 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:35.865 18:00:44 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:35.865 18:00:44 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:35.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:35.865 18:00:44 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:35.865 18:00:44 -- common/autotest_common.sh@10 -- # set +x 00:12:35.865 [2024-04-26 18:00:44.999578] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:35.865 [2024-04-26 18:00:44.999633] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid929275 ] 00:12:35.865 EAL: No free 2048 kB hugepages reported on node 1 00:12:36.124 [2024-04-26 18:00:45.070455] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:36.124 [2024-04-26 18:00:45.149978] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:36.690 18:00:45 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:36.690 18:00:45 -- common/autotest_common.sh@860 -- # return 0 00:12:36.690 18:00:45 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:36.949 Nvme0n1 00:12:36.949 18:00:46 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:37.209 [ 00:12:37.209 { 00:12:37.209 "name": "Nvme0n1", 00:12:37.209 "aliases": [ 00:12:37.209 "69913a66-2212-428b-9977-d6f297849522" 00:12:37.209 ], 00:12:37.209 "product_name": "NVMe disk", 00:12:37.209 "block_size": 4096, 00:12:37.209 "num_blocks": 38912, 00:12:37.209 "uuid": "69913a66-2212-428b-9977-d6f297849522", 00:12:37.209 "assigned_rate_limits": { 00:12:37.209 "rw_ios_per_sec": 0, 00:12:37.209 "rw_mbytes_per_sec": 0, 00:12:37.209 "r_mbytes_per_sec": 0, 00:12:37.209 "w_mbytes_per_sec": 0 00:12:37.209 }, 00:12:37.209 "claimed": false, 00:12:37.209 "zoned": false, 00:12:37.209 "supported_io_types": { 00:12:37.209 "read": true, 00:12:37.209 "write": true, 00:12:37.209 "unmap": true, 00:12:37.209 "write_zeroes": true, 00:12:37.209 "flush": true, 00:12:37.209 "reset": true, 00:12:37.209 "compare": true, 00:12:37.209 "compare_and_write": true, 00:12:37.209 "abort": true, 00:12:37.209 "nvme_admin": true, 00:12:37.209 "nvme_io": true 00:12:37.209 }, 00:12:37.209 "memory_domains": [ 00:12:37.209 { 00:12:37.209 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:12:37.209 "dma_device_type": 0 00:12:37.209 } 00:12:37.209 ], 00:12:37.209 "driver_specific": { 00:12:37.209 "nvme": [ 00:12:37.209 { 00:12:37.209 "trid": { 00:12:37.209 "trtype": "RDMA", 00:12:37.209 "adrfam": "IPv4", 00:12:37.209 "traddr": "192.168.100.8", 00:12:37.209 "trsvcid": "4420", 00:12:37.209 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:37.209 }, 00:12:37.209 "ctrlr_data": { 00:12:37.209 "cntlid": 1, 00:12:37.209 "vendor_id": "0x8086", 00:12:37.209 "model_number": "SPDK bdev Controller", 00:12:37.209 "serial_number": "SPDK0", 00:12:37.209 "firmware_revision": "24.05", 00:12:37.209 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:37.209 "oacs": { 00:12:37.209 "security": 0, 00:12:37.209 "format": 0, 00:12:37.209 "firmware": 0, 00:12:37.209 "ns_manage": 0 00:12:37.209 }, 00:12:37.209 "multi_ctrlr": true, 00:12:37.209 "ana_reporting": false 00:12:37.209 }, 00:12:37.209 "vs": { 00:12:37.209 "nvme_version": "1.3" 00:12:37.209 }, 00:12:37.209 "ns_data": { 00:12:37.209 "id": 1, 00:12:37.209 "can_share": true 00:12:37.209 } 00:12:37.209 } 00:12:37.209 ], 00:12:37.209 "mp_policy": "active_passive" 00:12:37.209 } 00:12:37.209 } 00:12:37.209 ] 00:12:37.209 18:00:46 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=929400 00:12:37.209 18:00:46 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:37.209 18:00:46 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:37.209 Running I/O for 10 seconds... 00:12:38.147 Latency(us) 00:12:38.147 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:38.147 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:38.147 Nvme0n1 : 1.00 34787.00 135.89 0.00 0.00 0.00 0.00 0.00 00:12:38.147 =================================================================================================================== 00:12:38.147 Total : 34787.00 135.89 0.00 0.00 0.00 0.00 0.00 00:12:38.147 00:12:39.083 18:00:48 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:39.342 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:39.342 Nvme0n1 : 2.00 35183.00 137.43 0.00 0.00 0.00 0.00 0.00 00:12:39.342 =================================================================================================================== 00:12:39.342 Total : 35183.00 137.43 0.00 0.00 0.00 0.00 0.00 00:12:39.342 00:12:39.342 true 00:12:39.342 18:00:48 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:39.342 18:00:48 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:39.609 18:00:48 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:39.609 18:00:48 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:39.609 18:00:48 -- target/nvmf_lvs_grow.sh@65 -- # wait 929400 00:12:40.178 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:40.178 Nvme0n1 : 3.00 35285.00 137.83 0.00 0.00 0.00 0.00 0.00 00:12:40.178 =================================================================================================================== 00:12:40.178 Total : 35285.00 137.83 0.00 0.00 0.00 0.00 0.00 00:12:40.178 00:12:41.115 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:41.115 Nvme0n1 : 4.00 35319.75 137.97 0.00 0.00 0.00 0.00 0.00 00:12:41.115 =================================================================================================================== 00:12:41.115 Total : 35319.75 137.97 0.00 0.00 0.00 0.00 0.00 00:12:41.115 00:12:42.493 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:42.493 Nvme0n1 : 5.00 35346.80 138.07 0.00 0.00 0.00 0.00 0.00 00:12:42.493 =================================================================================================================== 00:12:42.493 Total : 35346.80 138.07 0.00 0.00 0.00 0.00 0.00 00:12:42.493 00:12:43.430 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:43.431 Nvme0n1 : 6.00 35413.00 138.33 0.00 0.00 0.00 0.00 0.00 00:12:43.431 =================================================================================================================== 00:12:43.431 Total : 35413.00 138.33 0.00 0.00 0.00 0.00 0.00 00:12:43.431 00:12:44.368 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:44.368 Nvme0n1 : 7.00 35447.29 138.47 0.00 0.00 0.00 0.00 0.00 00:12:44.368 =================================================================================================================== 00:12:44.368 Total : 35447.29 138.47 0.00 0.00 0.00 0.00 0.00 00:12:44.368 00:12:45.305 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:45.305 Nvme0n1 : 8.00 35499.62 138.67 0.00 0.00 0.00 0.00 0.00 00:12:45.305 =================================================================================================================== 00:12:45.305 Total : 35499.62 138.67 0.00 0.00 0.00 0.00 0.00 00:12:45.305 00:12:46.240 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:46.240 Nvme0n1 : 9.00 35544.44 138.85 0.00 0.00 0.00 0.00 0.00 00:12:46.240 =================================================================================================================== 00:12:46.240 Total : 35544.44 138.85 0.00 0.00 0.00 0.00 0.00 00:12:46.240 00:12:47.177 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:47.177 Nvme0n1 : 10.00 35557.80 138.90 0.00 0.00 0.00 0.00 0.00 00:12:47.177 =================================================================================================================== 00:12:47.177 Total : 35557.80 138.90 0.00 0.00 0.00 0.00 0.00 00:12:47.177 00:12:47.177 00:12:47.177 Latency(us) 00:12:47.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:47.177 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:47.177 Nvme0n1 : 10.00 35558.24 138.90 0.00 0.00 3596.93 2436.23 16184.54 00:12:47.177 =================================================================================================================== 00:12:47.177 Total : 35558.24 138.90 0.00 0.00 3596.93 2436.23 16184.54 00:12:47.177 0 00:12:47.177 18:00:56 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 929275 00:12:47.177 18:00:56 -- common/autotest_common.sh@946 -- # '[' -z 929275 ']' 00:12:47.177 18:00:56 -- common/autotest_common.sh@950 -- # kill -0 929275 00:12:47.177 18:00:56 -- common/autotest_common.sh@951 -- # uname 00:12:47.177 18:00:56 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:12:47.177 18:00:56 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 929275 00:12:47.177 18:00:56 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:12:47.177 18:00:56 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:12:47.177 18:00:56 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 929275' 00:12:47.177 killing process with pid 929275 00:12:47.177 18:00:56 -- common/autotest_common.sh@965 -- # kill 929275 00:12:47.177 Received shutdown signal, test time was about 10.000000 seconds 00:12:47.177 00:12:47.177 Latency(us) 00:12:47.177 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:47.177 =================================================================================================================== 00:12:47.177 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:12:47.177 18:00:56 -- common/autotest_common.sh@970 -- # wait 929275 00:12:47.435 18:00:56 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:47.693 18:00:56 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:47.693 18:00:56 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:12:47.952 18:00:56 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:12:47.952 18:00:56 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:12:47.952 18:00:56 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:47.952 [2024-04-26 18:00:57.117899] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:12:48.209 18:00:57 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:48.209 18:00:57 -- common/autotest_common.sh@648 -- # local es=0 00:12:48.209 18:00:57 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:48.209 18:00:57 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.209 18:00:57 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.209 18:00:57 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.209 18:00:57 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.209 18:00:57 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.209 18:00:57 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:12:48.209 18:00:57 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:12:48.209 18:00:57 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:12:48.209 18:00:57 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:48.209 request: 00:12:48.209 { 00:12:48.209 "uuid": "db45297a-edcd-492b-9a3b-76b112e89e0f", 00:12:48.209 "method": "bdev_lvol_get_lvstores", 00:12:48.209 "req_id": 1 00:12:48.209 } 00:12:48.209 Got JSON-RPC error response 00:12:48.209 response: 00:12:48.209 { 00:12:48.209 "code": -19, 00:12:48.209 "message": "No such device" 00:12:48.209 } 00:12:48.209 18:00:57 -- common/autotest_common.sh@651 -- # es=1 00:12:48.209 18:00:57 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:12:48.209 18:00:57 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:12:48.209 18:00:57 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:12:48.209 18:00:57 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:48.467 aio_bdev 00:12:48.467 18:00:57 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 69913a66-2212-428b-9977-d6f297849522 00:12:48.467 18:00:57 -- common/autotest_common.sh@895 -- # local bdev_name=69913a66-2212-428b-9977-d6f297849522 00:12:48.467 18:00:57 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:12:48.467 18:00:57 -- common/autotest_common.sh@897 -- # local i 00:12:48.467 18:00:57 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:12:48.467 18:00:57 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:12:48.467 18:00:57 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:12:48.728 18:00:57 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 69913a66-2212-428b-9977-d6f297849522 -t 2000 00:12:48.728 [ 00:12:48.728 { 00:12:48.728 "name": "69913a66-2212-428b-9977-d6f297849522", 00:12:48.728 "aliases": [ 00:12:48.728 "lvs/lvol" 00:12:48.728 ], 00:12:48.728 "product_name": "Logical Volume", 00:12:48.728 "block_size": 4096, 00:12:48.728 "num_blocks": 38912, 00:12:48.728 "uuid": "69913a66-2212-428b-9977-d6f297849522", 00:12:48.728 "assigned_rate_limits": { 00:12:48.728 "rw_ios_per_sec": 0, 00:12:48.728 "rw_mbytes_per_sec": 0, 00:12:48.728 "r_mbytes_per_sec": 0, 00:12:48.728 "w_mbytes_per_sec": 0 00:12:48.728 }, 00:12:48.728 "claimed": false, 00:12:48.728 "zoned": false, 00:12:48.728 "supported_io_types": { 00:12:48.728 "read": true, 00:12:48.728 "write": true, 00:12:48.728 "unmap": true, 00:12:48.728 "write_zeroes": true, 00:12:48.728 "flush": false, 00:12:48.728 "reset": true, 00:12:48.728 "compare": false, 00:12:48.728 "compare_and_write": false, 00:12:48.728 "abort": false, 00:12:48.728 "nvme_admin": false, 00:12:48.728 "nvme_io": false 00:12:48.728 }, 00:12:48.728 "driver_specific": { 00:12:48.728 "lvol": { 00:12:48.728 "lvol_store_uuid": "db45297a-edcd-492b-9a3b-76b112e89e0f", 00:12:48.728 "base_bdev": "aio_bdev", 00:12:48.728 "thin_provision": false, 00:12:48.728 "snapshot": false, 00:12:48.728 "clone": false, 00:12:48.728 "esnap_clone": false 00:12:48.728 } 00:12:48.728 } 00:12:48.728 } 00:12:48.728 ] 00:12:48.728 18:00:57 -- common/autotest_common.sh@903 -- # return 0 00:12:48.728 18:00:57 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:48.728 18:00:57 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:12:49.038 18:00:58 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:12:49.038 18:00:58 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:49.038 18:00:58 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:12:49.038 18:00:58 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:12:49.038 18:00:58 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 69913a66-2212-428b-9977-d6f297849522 00:12:49.296 18:00:58 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u db45297a-edcd-492b-9a3b-76b112e89e0f 00:12:49.555 18:00:58 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:12:49.555 18:00:58 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:49.814 00:12:49.814 real 0m15.498s 00:12:49.814 user 0m15.372s 00:12:49.814 sys 0m1.123s 00:12:49.814 18:00:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:12:49.814 18:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:49.814 ************************************ 00:12:49.814 END TEST lvs_grow_clean 00:12:49.814 ************************************ 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:12:49.814 18:00:58 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:12:49.814 18:00:58 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:12:49.814 18:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:49.814 ************************************ 00:12:49.814 START TEST lvs_grow_dirty 00:12:49.814 ************************************ 00:12:49.814 18:00:58 -- common/autotest_common.sh@1121 -- # lvs_grow dirty 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:49.814 18:00:58 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:12:50.072 18:00:59 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:12:50.072 18:00:59 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@28 -- # lvs=a509eaa2-6f69-4423-9b76-c57805613668 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:12:50.330 18:00:59 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u a509eaa2-6f69-4423-9b76-c57805613668 lvol 150 00:12:50.589 18:00:59 -- target/nvmf_lvs_grow.sh@33 -- # lvol=8abe3003-3769-4be3-8cee-66d2e17802f8 00:12:50.589 18:00:59 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:12:50.589 18:00:59 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:12:50.848 [2024-04-26 18:00:59.853234] bdev_aio.c:1030:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:12:50.848 [2024-04-26 18:00:59.853304] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:12:50.848 true 00:12:50.848 18:00:59 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:12:50.848 18:00:59 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:12:51.106 18:01:00 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:12:51.106 18:01:00 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:51.106 18:01:00 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 8abe3003-3769-4be3-8cee-66d2e17802f8 00:12:51.364 18:01:00 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:12:51.623 18:01:00 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:12:51.623 18:01:00 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=931363 00:12:51.623 18:01:00 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:12:51.623 18:01:00 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 931363 /var/tmp/bdevperf.sock 00:12:51.623 18:01:00 -- common/autotest_common.sh@827 -- # '[' -z 931363 ']' 00:12:51.623 18:01:00 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:12:51.623 18:01:00 -- common/autotest_common.sh@832 -- # local max_retries=100 00:12:51.623 18:01:00 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:12:51.623 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:12:51.623 18:01:00 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:12:51.623 18:01:00 -- common/autotest_common.sh@836 -- # xtrace_disable 00:12:51.623 18:01:00 -- common/autotest_common.sh@10 -- # set +x 00:12:51.623 [2024-04-26 18:01:00.809663] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:12:51.623 [2024-04-26 18:01:00.809722] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid931363 ] 00:12:51.882 EAL: No free 2048 kB hugepages reported on node 1 00:12:51.882 [2024-04-26 18:01:00.878910] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:12:51.882 [2024-04-26 18:01:00.957427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:52.450 18:01:01 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:12:52.450 18:01:01 -- common/autotest_common.sh@860 -- # return 0 00:12:52.450 18:01:01 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:12:52.708 Nvme0n1 00:12:52.708 18:01:01 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:12:52.967 [ 00:12:52.967 { 00:12:52.967 "name": "Nvme0n1", 00:12:52.967 "aliases": [ 00:12:52.967 "8abe3003-3769-4be3-8cee-66d2e17802f8" 00:12:52.967 ], 00:12:52.967 "product_name": "NVMe disk", 00:12:52.967 "block_size": 4096, 00:12:52.967 "num_blocks": 38912, 00:12:52.967 "uuid": "8abe3003-3769-4be3-8cee-66d2e17802f8", 00:12:52.967 "assigned_rate_limits": { 00:12:52.967 "rw_ios_per_sec": 0, 00:12:52.967 "rw_mbytes_per_sec": 0, 00:12:52.967 "r_mbytes_per_sec": 0, 00:12:52.967 "w_mbytes_per_sec": 0 00:12:52.967 }, 00:12:52.967 "claimed": false, 00:12:52.967 "zoned": false, 00:12:52.967 "supported_io_types": { 00:12:52.967 "read": true, 00:12:52.967 "write": true, 00:12:52.967 "unmap": true, 00:12:52.967 "write_zeroes": true, 00:12:52.967 "flush": true, 00:12:52.967 "reset": true, 00:12:52.967 "compare": true, 00:12:52.967 "compare_and_write": true, 00:12:52.967 "abort": true, 00:12:52.967 "nvme_admin": true, 00:12:52.967 "nvme_io": true 00:12:52.967 }, 00:12:52.967 "memory_domains": [ 00:12:52.967 { 00:12:52.967 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:12:52.967 "dma_device_type": 0 00:12:52.967 } 00:12:52.967 ], 00:12:52.967 "driver_specific": { 00:12:52.967 "nvme": [ 00:12:52.967 { 00:12:52.967 "trid": { 00:12:52.967 "trtype": "RDMA", 00:12:52.967 "adrfam": "IPv4", 00:12:52.967 "traddr": "192.168.100.8", 00:12:52.967 "trsvcid": "4420", 00:12:52.967 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:12:52.967 }, 00:12:52.967 "ctrlr_data": { 00:12:52.967 "cntlid": 1, 00:12:52.967 "vendor_id": "0x8086", 00:12:52.967 "model_number": "SPDK bdev Controller", 00:12:52.967 "serial_number": "SPDK0", 00:12:52.967 "firmware_revision": "24.05", 00:12:52.967 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:12:52.967 "oacs": { 00:12:52.967 "security": 0, 00:12:52.967 "format": 0, 00:12:52.967 "firmware": 0, 00:12:52.967 "ns_manage": 0 00:12:52.967 }, 00:12:52.967 "multi_ctrlr": true, 00:12:52.967 "ana_reporting": false 00:12:52.967 }, 00:12:52.967 "vs": { 00:12:52.967 "nvme_version": "1.3" 00:12:52.967 }, 00:12:52.967 "ns_data": { 00:12:52.967 "id": 1, 00:12:52.967 "can_share": true 00:12:52.967 } 00:12:52.967 } 00:12:52.967 ], 00:12:52.967 "mp_policy": "active_passive" 00:12:52.967 } 00:12:52.967 } 00:12:52.967 ] 00:12:52.967 18:01:02 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=931546 00:12:52.967 18:01:02 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:12:52.967 18:01:02 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:12:52.967 Running I/O for 10 seconds... 00:12:54.341 Latency(us) 00:12:54.341 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:12:54.341 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:54.341 Nvme0n1 : 1.00 35005.00 136.74 0.00 0.00 0.00 0.00 0.00 00:12:54.341 =================================================================================================================== 00:12:54.341 Total : 35005.00 136.74 0.00 0.00 0.00 0.00 0.00 00:12:54.341 00:12:54.908 18:01:04 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u a509eaa2-6f69-4423-9b76-c57805613668 00:12:55.168 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:55.168 Nvme0n1 : 2.00 35266.50 137.76 0.00 0.00 0.00 0.00 0.00 00:12:55.168 =================================================================================================================== 00:12:55.168 Total : 35266.50 137.76 0.00 0.00 0.00 0.00 0.00 00:12:55.168 00:12:55.168 true 00:12:55.168 18:01:04 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:12:55.168 18:01:04 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:12:55.427 18:01:04 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:12:55.427 18:01:04 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:12:55.427 18:01:04 -- target/nvmf_lvs_grow.sh@65 -- # wait 931546 00:12:55.993 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:55.993 Nvme0n1 : 3.00 35359.33 138.12 0.00 0.00 0.00 0.00 0.00 00:12:55.993 =================================================================================================================== 00:12:55.993 Total : 35359.33 138.12 0.00 0.00 0.00 0.00 0.00 00:12:55.993 00:12:57.369 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:57.369 Nvme0n1 : 4.00 35439.00 138.43 0.00 0.00 0.00 0.00 0.00 00:12:57.369 =================================================================================================================== 00:12:57.369 Total : 35439.00 138.43 0.00 0.00 0.00 0.00 0.00 00:12:57.369 00:12:58.307 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:58.307 Nvme0n1 : 5.00 35519.00 138.75 0.00 0.00 0.00 0.00 0.00 00:12:58.307 =================================================================================================================== 00:12:58.308 Total : 35519.00 138.75 0.00 0.00 0.00 0.00 0.00 00:12:58.308 00:12:59.244 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:12:59.244 Nvme0n1 : 6.00 35579.50 138.98 0.00 0.00 0.00 0.00 0.00 00:12:59.244 =================================================================================================================== 00:12:59.244 Total : 35579.50 138.98 0.00 0.00 0.00 0.00 0.00 00:12:59.244 00:13:00.181 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:00.181 Nvme0n1 : 7.00 35619.43 139.14 0.00 0.00 0.00 0.00 0.00 00:13:00.181 =================================================================================================================== 00:13:00.181 Total : 35619.43 139.14 0.00 0.00 0.00 0.00 0.00 00:13:00.181 00:13:01.119 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:01.120 Nvme0n1 : 8.00 35629.12 139.18 0.00 0.00 0.00 0.00 0.00 00:13:01.120 =================================================================================================================== 00:13:01.120 Total : 35629.12 139.18 0.00 0.00 0.00 0.00 0.00 00:13:01.120 00:13:02.058 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:02.058 Nvme0n1 : 9.00 35568.78 138.94 0.00 0.00 0.00 0.00 0.00 00:13:02.058 =================================================================================================================== 00:13:02.058 Total : 35568.78 138.94 0.00 0.00 0.00 0.00 0.00 00:13:02.058 00:13:02.999 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:02.999 Nvme0n1 : 10.00 35598.90 139.06 0.00 0.00 0.00 0.00 0.00 00:13:02.999 =================================================================================================================== 00:13:02.999 Total : 35598.90 139.06 0.00 0.00 0.00 0.00 0.00 00:13:02.999 00:13:02.999 00:13:02.999 Latency(us) 00:13:02.999 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:02.999 Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:13:02.999 Nvme0n1 : 10.00 35599.30 139.06 0.00 0.00 3592.88 2436.23 7921.31 00:13:02.999 =================================================================================================================== 00:13:02.999 Total : 35599.30 139.06 0.00 0.00 3592.88 2436.23 7921.31 00:13:02.999 0 00:13:02.999 18:01:12 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 931363 00:13:02.999 18:01:12 -- common/autotest_common.sh@946 -- # '[' -z 931363 ']' 00:13:02.999 18:01:12 -- common/autotest_common.sh@950 -- # kill -0 931363 00:13:02.999 18:01:12 -- common/autotest_common.sh@951 -- # uname 00:13:02.999 18:01:12 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:02.999 18:01:12 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 931363 00:13:03.259 18:01:12 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:13:03.259 18:01:12 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:13:03.259 18:01:12 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 931363' 00:13:03.259 killing process with pid 931363 00:13:03.259 18:01:12 -- common/autotest_common.sh@965 -- # kill 931363 00:13:03.259 Received shutdown signal, test time was about 10.000000 seconds 00:13:03.259 00:13:03.259 Latency(us) 00:13:03.259 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:03.259 =================================================================================================================== 00:13:03.259 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:13:03.259 18:01:12 -- common/autotest_common.sh@970 -- # wait 931363 00:13:03.259 18:01:12 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:03.517 18:01:12 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:03.517 18:01:12 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 928770 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@74 -- # wait 928770 00:13:03.775 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 928770 Killed "${NVMF_APP[@]}" "$@" 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@74 -- # true 00:13:03.775 18:01:12 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:13:03.775 18:01:12 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:03.775 18:01:12 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:03.775 18:01:12 -- common/autotest_common.sh@10 -- # set +x 00:13:03.775 18:01:12 -- nvmf/common.sh@470 -- # nvmfpid=933006 00:13:03.775 18:01:12 -- nvmf/common.sh@471 -- # waitforlisten 933006 00:13:03.775 18:01:12 -- common/autotest_common.sh@827 -- # '[' -z 933006 ']' 00:13:03.775 18:01:12 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:03.775 18:01:12 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:03.775 18:01:12 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:03.775 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:03.775 18:01:12 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:03.775 18:01:12 -- common/autotest_common.sh@10 -- # set +x 00:13:03.775 18:01:12 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:13:03.775 [2024-04-26 18:01:12.903101] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:03.775 [2024-04-26 18:01:12.903159] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:03.775 EAL: No free 2048 kB hugepages reported on node 1 00:13:04.034 [2024-04-26 18:01:12.976480] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:04.034 [2024-04-26 18:01:13.064053] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:04.034 [2024-04-26 18:01:13.064093] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:04.034 [2024-04-26 18:01:13.064102] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:04.034 [2024-04-26 18:01:13.064127] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:04.034 [2024-04-26 18:01:13.064134] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:04.034 [2024-04-26 18:01:13.064160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:04.601 18:01:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:04.601 18:01:13 -- common/autotest_common.sh@860 -- # return 0 00:13:04.601 18:01:13 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:04.601 18:01:13 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:04.601 18:01:13 -- common/autotest_common.sh@10 -- # set +x 00:13:04.601 18:01:13 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:04.601 18:01:13 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:04.860 [2024-04-26 18:01:13.911204] blobstore.c:4779:bs_recover: *NOTICE*: Performing recovery on blobstore 00:13:04.860 [2024-04-26 18:01:13.911307] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:13:04.860 [2024-04-26 18:01:13.911334] blobstore.c:4726:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:13:04.860 18:01:13 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:13:04.860 18:01:13 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 8abe3003-3769-4be3-8cee-66d2e17802f8 00:13:04.860 18:01:13 -- common/autotest_common.sh@895 -- # local bdev_name=8abe3003-3769-4be3-8cee-66d2e17802f8 00:13:04.860 18:01:13 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:13:04.860 18:01:13 -- common/autotest_common.sh@897 -- # local i 00:13:04.860 18:01:13 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:13:04.860 18:01:13 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:13:04.860 18:01:13 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:13:05.120 18:01:14 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8abe3003-3769-4be3-8cee-66d2e17802f8 -t 2000 00:13:05.120 [ 00:13:05.120 { 00:13:05.120 "name": "8abe3003-3769-4be3-8cee-66d2e17802f8", 00:13:05.120 "aliases": [ 00:13:05.120 "lvs/lvol" 00:13:05.120 ], 00:13:05.120 "product_name": "Logical Volume", 00:13:05.120 "block_size": 4096, 00:13:05.120 "num_blocks": 38912, 00:13:05.120 "uuid": "8abe3003-3769-4be3-8cee-66d2e17802f8", 00:13:05.120 "assigned_rate_limits": { 00:13:05.120 "rw_ios_per_sec": 0, 00:13:05.120 "rw_mbytes_per_sec": 0, 00:13:05.120 "r_mbytes_per_sec": 0, 00:13:05.120 "w_mbytes_per_sec": 0 00:13:05.120 }, 00:13:05.120 "claimed": false, 00:13:05.120 "zoned": false, 00:13:05.120 "supported_io_types": { 00:13:05.120 "read": true, 00:13:05.120 "write": true, 00:13:05.120 "unmap": true, 00:13:05.120 "write_zeroes": true, 00:13:05.120 "flush": false, 00:13:05.120 "reset": true, 00:13:05.120 "compare": false, 00:13:05.120 "compare_and_write": false, 00:13:05.120 "abort": false, 00:13:05.120 "nvme_admin": false, 00:13:05.120 "nvme_io": false 00:13:05.120 }, 00:13:05.120 "driver_specific": { 00:13:05.120 "lvol": { 00:13:05.120 "lvol_store_uuid": "a509eaa2-6f69-4423-9b76-c57805613668", 00:13:05.120 "base_bdev": "aio_bdev", 00:13:05.120 "thin_provision": false, 00:13:05.120 "snapshot": false, 00:13:05.120 "clone": false, 00:13:05.120 "esnap_clone": false 00:13:05.120 } 00:13:05.120 } 00:13:05.120 } 00:13:05.120 ] 00:13:05.120 18:01:14 -- common/autotest_common.sh@903 -- # return 0 00:13:05.120 18:01:14 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:05.120 18:01:14 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:13:05.379 18:01:14 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:13:05.379 18:01:14 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:05.379 18:01:14 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:13:05.638 18:01:14 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:13:05.638 18:01:14 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:13:05.638 [2024-04-26 18:01:14.775514] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:13:05.638 18:01:14 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:05.638 18:01:14 -- common/autotest_common.sh@648 -- # local es=0 00:13:05.638 18:01:14 -- common/autotest_common.sh@650 -- # valid_exec_arg /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:05.639 18:01:14 -- common/autotest_common.sh@636 -- # local arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:05.639 18:01:14 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:13:05.639 18:01:14 -- common/autotest_common.sh@640 -- # type -t /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:05.639 18:01:14 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:13:05.639 18:01:14 -- common/autotest_common.sh@642 -- # type -P /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:05.639 18:01:14 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:13:05.639 18:01:14 -- common/autotest_common.sh@642 -- # arg=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:05.639 18:01:14 -- common/autotest_common.sh@642 -- # [[ -x /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py ]] 00:13:05.639 18:01:14 -- common/autotest_common.sh@651 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:05.913 request: 00:13:05.913 { 00:13:05.913 "uuid": "a509eaa2-6f69-4423-9b76-c57805613668", 00:13:05.913 "method": "bdev_lvol_get_lvstores", 00:13:05.913 "req_id": 1 00:13:05.913 } 00:13:05.913 Got JSON-RPC error response 00:13:05.913 response: 00:13:05.913 { 00:13:05.913 "code": -19, 00:13:05.913 "message": "No such device" 00:13:05.913 } 00:13:05.913 18:01:14 -- common/autotest_common.sh@651 -- # es=1 00:13:05.913 18:01:14 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:13:05.913 18:01:14 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:13:05.913 18:01:14 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:13:05.913 18:01:14 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:13:06.179 aio_bdev 00:13:06.179 18:01:15 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 8abe3003-3769-4be3-8cee-66d2e17802f8 00:13:06.179 18:01:15 -- common/autotest_common.sh@895 -- # local bdev_name=8abe3003-3769-4be3-8cee-66d2e17802f8 00:13:06.179 18:01:15 -- common/autotest_common.sh@896 -- # local bdev_timeout= 00:13:06.179 18:01:15 -- common/autotest_common.sh@897 -- # local i 00:13:06.179 18:01:15 -- common/autotest_common.sh@898 -- # [[ -z '' ]] 00:13:06.179 18:01:15 -- common/autotest_common.sh@898 -- # bdev_timeout=2000 00:13:06.179 18:01:15 -- common/autotest_common.sh@900 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:13:06.179 18:01:15 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 8abe3003-3769-4be3-8cee-66d2e17802f8 -t 2000 00:13:06.438 [ 00:13:06.438 { 00:13:06.438 "name": "8abe3003-3769-4be3-8cee-66d2e17802f8", 00:13:06.438 "aliases": [ 00:13:06.438 "lvs/lvol" 00:13:06.438 ], 00:13:06.438 "product_name": "Logical Volume", 00:13:06.438 "block_size": 4096, 00:13:06.438 "num_blocks": 38912, 00:13:06.438 "uuid": "8abe3003-3769-4be3-8cee-66d2e17802f8", 00:13:06.438 "assigned_rate_limits": { 00:13:06.438 "rw_ios_per_sec": 0, 00:13:06.438 "rw_mbytes_per_sec": 0, 00:13:06.438 "r_mbytes_per_sec": 0, 00:13:06.438 "w_mbytes_per_sec": 0 00:13:06.438 }, 00:13:06.438 "claimed": false, 00:13:06.438 "zoned": false, 00:13:06.438 "supported_io_types": { 00:13:06.438 "read": true, 00:13:06.438 "write": true, 00:13:06.438 "unmap": true, 00:13:06.438 "write_zeroes": true, 00:13:06.438 "flush": false, 00:13:06.438 "reset": true, 00:13:06.438 "compare": false, 00:13:06.438 "compare_and_write": false, 00:13:06.438 "abort": false, 00:13:06.438 "nvme_admin": false, 00:13:06.438 "nvme_io": false 00:13:06.438 }, 00:13:06.438 "driver_specific": { 00:13:06.438 "lvol": { 00:13:06.438 "lvol_store_uuid": "a509eaa2-6f69-4423-9b76-c57805613668", 00:13:06.438 "base_bdev": "aio_bdev", 00:13:06.438 "thin_provision": false, 00:13:06.438 "snapshot": false, 00:13:06.438 "clone": false, 00:13:06.438 "esnap_clone": false 00:13:06.438 } 00:13:06.438 } 00:13:06.438 } 00:13:06.438 ] 00:13:06.438 18:01:15 -- common/autotest_common.sh@903 -- # return 0 00:13:06.438 18:01:15 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:06.438 18:01:15 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:13:06.697 18:01:15 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:13:06.697 18:01:15 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:06.697 18:01:15 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:13:06.697 18:01:15 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:13:06.697 18:01:15 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 8abe3003-3769-4be3-8cee-66d2e17802f8 00:13:06.955 18:01:16 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u a509eaa2-6f69-4423-9b76-c57805613668 00:13:07.215 18:01:16 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:13:07.215 18:01:16 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:13:07.215 00:13:07.215 real 0m17.441s 00:13:07.215 user 0m45.109s 00:13:07.215 sys 0m3.475s 00:13:07.215 18:01:16 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:07.215 18:01:16 -- common/autotest_common.sh@10 -- # set +x 00:13:07.215 ************************************ 00:13:07.215 END TEST lvs_grow_dirty 00:13:07.215 ************************************ 00:13:07.474 18:01:16 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:13:07.474 18:01:16 -- common/autotest_common.sh@804 -- # type=--id 00:13:07.474 18:01:16 -- common/autotest_common.sh@805 -- # id=0 00:13:07.474 18:01:16 -- common/autotest_common.sh@806 -- # '[' --id = --pid ']' 00:13:07.474 18:01:16 -- common/autotest_common.sh@810 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:13:07.474 18:01:16 -- common/autotest_common.sh@810 -- # shm_files=nvmf_trace.0 00:13:07.474 18:01:16 -- common/autotest_common.sh@812 -- # [[ -z nvmf_trace.0 ]] 00:13:07.474 18:01:16 -- common/autotest_common.sh@816 -- # for n in $shm_files 00:13:07.474 18:01:16 -- common/autotest_common.sh@817 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:13:07.474 nvmf_trace.0 00:13:07.474 18:01:16 -- common/autotest_common.sh@819 -- # return 0 00:13:07.474 18:01:16 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:13:07.474 18:01:16 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:07.474 18:01:16 -- nvmf/common.sh@117 -- # sync 00:13:07.474 18:01:16 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:07.474 18:01:16 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:07.474 18:01:16 -- nvmf/common.sh@120 -- # set +e 00:13:07.474 18:01:16 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:07.474 18:01:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:07.474 rmmod nvme_rdma 00:13:07.474 rmmod nvme_fabrics 00:13:07.474 18:01:16 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:07.474 18:01:16 -- nvmf/common.sh@124 -- # set -e 00:13:07.474 18:01:16 -- nvmf/common.sh@125 -- # return 0 00:13:07.474 18:01:16 -- nvmf/common.sh@478 -- # '[' -n 933006 ']' 00:13:07.474 18:01:16 -- nvmf/common.sh@479 -- # killprocess 933006 00:13:07.474 18:01:16 -- common/autotest_common.sh@946 -- # '[' -z 933006 ']' 00:13:07.474 18:01:16 -- common/autotest_common.sh@950 -- # kill -0 933006 00:13:07.474 18:01:16 -- common/autotest_common.sh@951 -- # uname 00:13:07.474 18:01:16 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:07.474 18:01:16 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 933006 00:13:07.475 18:01:16 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:13:07.475 18:01:16 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:13:07.475 18:01:16 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 933006' 00:13:07.475 killing process with pid 933006 00:13:07.475 18:01:16 -- common/autotest_common.sh@965 -- # kill 933006 00:13:07.475 18:01:16 -- common/autotest_common.sh@970 -- # wait 933006 00:13:07.734 18:01:16 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:07.734 18:01:16 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:07.734 00:13:07.734 real 0m41.032s 00:13:07.734 user 1m6.677s 00:13:07.734 sys 0m9.752s 00:13:07.734 18:01:16 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:07.734 18:01:16 -- common/autotest_common.sh@10 -- # set +x 00:13:07.734 ************************************ 00:13:07.734 END TEST nvmf_lvs_grow 00:13:07.734 ************************************ 00:13:07.734 18:01:16 -- nvmf/nvmf.sh@50 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:13:07.734 18:01:16 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:07.734 18:01:16 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:07.734 18:01:16 -- common/autotest_common.sh@10 -- # set +x 00:13:07.993 ************************************ 00:13:07.993 START TEST nvmf_bdev_io_wait 00:13:07.993 ************************************ 00:13:07.993 18:01:17 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=rdma 00:13:07.993 * Looking for test storage... 00:13:07.993 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:07.993 18:01:17 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:07.993 18:01:17 -- nvmf/common.sh@7 -- # uname -s 00:13:07.993 18:01:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:07.993 18:01:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:07.994 18:01:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:07.994 18:01:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:07.994 18:01:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:07.994 18:01:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:07.994 18:01:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:07.994 18:01:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:07.994 18:01:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:07.994 18:01:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:07.994 18:01:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:07.994 18:01:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:07.994 18:01:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:07.994 18:01:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:07.994 18:01:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:07.994 18:01:17 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:07.994 18:01:17 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:07.994 18:01:17 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:07.994 18:01:17 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:07.994 18:01:17 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:07.994 18:01:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.994 18:01:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.994 18:01:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.994 18:01:17 -- paths/export.sh@5 -- # export PATH 00:13:07.994 18:01:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.994 18:01:17 -- nvmf/common.sh@47 -- # : 0 00:13:07.994 18:01:17 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:07.994 18:01:17 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:07.994 18:01:17 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:07.994 18:01:17 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:07.994 18:01:17 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:07.994 18:01:17 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:07.994 18:01:17 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:07.994 18:01:17 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:07.994 18:01:17 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:07.994 18:01:17 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:07.994 18:01:17 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:13:07.994 18:01:17 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:07.994 18:01:17 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:07.994 18:01:17 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:07.994 18:01:17 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:07.994 18:01:17 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:07.994 18:01:17 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.994 18:01:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.994 18:01:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:07.994 18:01:17 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:07.994 18:01:17 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:07.994 18:01:17 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:07.994 18:01:17 -- common/autotest_common.sh@10 -- # set +x 00:13:14.647 18:01:23 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:14.647 18:01:23 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:14.647 18:01:23 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:14.647 18:01:23 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:14.647 18:01:23 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:14.647 18:01:23 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:14.647 18:01:23 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:14.647 18:01:23 -- nvmf/common.sh@295 -- # net_devs=() 00:13:14.647 18:01:23 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:14.647 18:01:23 -- nvmf/common.sh@296 -- # e810=() 00:13:14.647 18:01:23 -- nvmf/common.sh@296 -- # local -ga e810 00:13:14.647 18:01:23 -- nvmf/common.sh@297 -- # x722=() 00:13:14.647 18:01:23 -- nvmf/common.sh@297 -- # local -ga x722 00:13:14.648 18:01:23 -- nvmf/common.sh@298 -- # mlx=() 00:13:14.648 18:01:23 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:14.648 18:01:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:14.648 18:01:23 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:14.648 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:14.648 18:01:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:14.648 18:01:23 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:14.648 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:14.648 18:01:23 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:14.648 18:01:23 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.648 18:01:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.648 18:01:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:14.648 Found net devices under 0000:18:00.0: mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.648 18:01:23 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.648 18:01:23 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:14.648 Found net devices under 0000:18:00.1: mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.648 18:01:23 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:14.648 18:01:23 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:14.648 18:01:23 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:14.648 18:01:23 -- nvmf/common.sh@58 -- # uname 00:13:14.648 18:01:23 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:14.648 18:01:23 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:14.648 18:01:23 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:14.648 18:01:23 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:14.648 18:01:23 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:14.648 18:01:23 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:14.648 18:01:23 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:14.648 18:01:23 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:14.648 18:01:23 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:14.648 18:01:23 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:14.648 18:01:23 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:14.648 18:01:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:14.648 18:01:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:14.648 18:01:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:14.648 18:01:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:14.648 18:01:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@105 -- # continue 2 00:13:14.648 18:01:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@105 -- # continue 2 00:13:14.648 18:01:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:14.648 18:01:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:14.648 18:01:23 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:14.648 18:01:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:14.648 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:14.648 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:14.648 altname enp24s0f0np0 00:13:14.648 altname ens785f0np0 00:13:14.648 inet 192.168.100.8/24 scope global mlx_0_0 00:13:14.648 valid_lft forever preferred_lft forever 00:13:14.648 18:01:23 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:14.648 18:01:23 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:14.648 18:01:23 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:14.648 18:01:23 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:14.648 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:14.648 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:14.648 altname enp24s0f1np1 00:13:14.648 altname ens785f1np1 00:13:14.648 inet 192.168.100.9/24 scope global mlx_0_1 00:13:14.648 valid_lft forever preferred_lft forever 00:13:14.648 18:01:23 -- nvmf/common.sh@411 -- # return 0 00:13:14.648 18:01:23 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:14.648 18:01:23 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:14.648 18:01:23 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:14.648 18:01:23 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:14.648 18:01:23 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:14.648 18:01:23 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:14.648 18:01:23 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:14.648 18:01:23 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:14.648 18:01:23 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:14.648 18:01:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@105 -- # continue 2 00:13:14.648 18:01:23 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:14.648 18:01:23 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:14.648 18:01:23 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@105 -- # continue 2 00:13:14.648 18:01:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:14.648 18:01:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:14.648 18:01:23 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:14.648 18:01:23 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:14.648 18:01:23 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:14.648 18:01:23 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:14.648 192.168.100.9' 00:13:14.648 18:01:23 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:14.648 192.168.100.9' 00:13:14.648 18:01:23 -- nvmf/common.sh@446 -- # head -n 1 00:13:14.648 18:01:23 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:14.648 18:01:23 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:14.648 192.168.100.9' 00:13:14.648 18:01:23 -- nvmf/common.sh@447 -- # tail -n +2 00:13:14.648 18:01:23 -- nvmf/common.sh@447 -- # head -n 1 00:13:14.648 18:01:23 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:14.648 18:01:23 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:14.648 18:01:23 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:14.648 18:01:23 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:14.648 18:01:23 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:14.648 18:01:23 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:14.648 18:01:23 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:13:14.648 18:01:23 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:14.648 18:01:23 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:14.648 18:01:23 -- common/autotest_common.sh@10 -- # set +x 00:13:14.648 18:01:23 -- nvmf/common.sh@470 -- # nvmfpid=936494 00:13:14.648 18:01:23 -- nvmf/common.sh@471 -- # waitforlisten 936494 00:13:14.648 18:01:23 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:13:14.648 18:01:23 -- common/autotest_common.sh@827 -- # '[' -z 936494 ']' 00:13:14.648 18:01:23 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:14.648 18:01:23 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:14.648 18:01:23 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:14.648 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:14.648 18:01:23 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:14.648 18:01:23 -- common/autotest_common.sh@10 -- # set +x 00:13:14.648 [2024-04-26 18:01:23.461875] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:14.648 [2024-04-26 18:01:23.461934] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:14.648 EAL: No free 2048 kB hugepages reported on node 1 00:13:14.648 [2024-04-26 18:01:23.532989] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:14.648 [2024-04-26 18:01:23.613722] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:14.648 [2024-04-26 18:01:23.613769] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:14.648 [2024-04-26 18:01:23.613779] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:14.648 [2024-04-26 18:01:23.613803] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:14.648 [2024-04-26 18:01:23.613810] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:14.648 [2024-04-26 18:01:23.613861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:14.648 [2024-04-26 18:01:23.613945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:14.648 [2024-04-26 18:01:23.614026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:14.648 [2024-04-26 18:01:23.614028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:15.217 18:01:24 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:15.217 18:01:24 -- common/autotest_common.sh@860 -- # return 0 00:13:15.217 18:01:24 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:15.217 18:01:24 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:15.217 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.217 18:01:24 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:15.217 18:01:24 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:13:15.217 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.217 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.217 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.217 18:01:24 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:13:15.217 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.217 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.217 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.217 18:01:24 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:15.217 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.217 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.217 [2024-04-26 18:01:24.409415] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a60540/0x1a64a30) succeed. 00:13:15.477 [2024-04-26 18:01:24.419528] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a61b30/0x1aa60c0) succeed. 00:13:15.477 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:15.477 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.477 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.477 Malloc0 00:13:15.477 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:15.477 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.477 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.477 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:15.477 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.477 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.477 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:15.477 18:01:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:15.477 18:01:24 -- common/autotest_common.sh@10 -- # set +x 00:13:15.477 [2024-04-26 18:01:24.610956] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:15.477 18:01:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=936616 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@30 -- # READ_PID=936619 00:13:15.477 18:01:24 -- nvmf/common.sh@521 -- # config=() 00:13:15.477 18:01:24 -- nvmf/common.sh@521 -- # local subsystem config 00:13:15.477 18:01:24 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:15.477 18:01:24 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:15.477 { 00:13:15.477 "params": { 00:13:15.477 "name": "Nvme$subsystem", 00:13:15.477 "trtype": "$TEST_TRANSPORT", 00:13:15.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:15.477 "adrfam": "ipv4", 00:13:15.477 "trsvcid": "$NVMF_PORT", 00:13:15.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:15.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:15.477 "hdgst": ${hdgst:-false}, 00:13:15.477 "ddgst": ${ddgst:-false} 00:13:15.477 }, 00:13:15.477 "method": "bdev_nvme_attach_controller" 00:13:15.477 } 00:13:15.477 EOF 00:13:15.477 )") 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=936622 00:13:15.477 18:01:24 -- nvmf/common.sh@521 -- # config=() 00:13:15.477 18:01:24 -- nvmf/common.sh@521 -- # local subsystem config 00:13:15.477 18:01:24 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:15.477 18:01:24 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:15.477 { 00:13:15.477 "params": { 00:13:15.477 "name": "Nvme$subsystem", 00:13:15.477 "trtype": "$TEST_TRANSPORT", 00:13:15.477 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:15.477 "adrfam": "ipv4", 00:13:15.477 "trsvcid": "$NVMF_PORT", 00:13:15.477 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:15.477 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:15.477 "hdgst": ${hdgst:-false}, 00:13:15.477 "ddgst": ${ddgst:-false} 00:13:15.477 }, 00:13:15.477 "method": "bdev_nvme_attach_controller" 00:13:15.477 } 00:13:15.477 EOF 00:13:15.477 )") 00:13:15.477 18:01:24 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=936625 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # cat 00:13:15.478 18:01:24 -- nvmf/common.sh@521 -- # config=() 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@35 -- # sync 00:13:15.478 18:01:24 -- nvmf/common.sh@521 -- # local subsystem config 00:13:15.478 18:01:24 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:15.478 { 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme$subsystem", 00:13:15.478 "trtype": "$TEST_TRANSPORT", 00:13:15.478 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "$NVMF_PORT", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:15.478 "hdgst": ${hdgst:-false}, 00:13:15.478 "ddgst": ${ddgst:-false} 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 } 00:13:15.478 EOF 00:13:15.478 )") 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # cat 00:13:15.478 18:01:24 -- nvmf/common.sh@521 -- # config=() 00:13:15.478 18:01:24 -- nvmf/common.sh@521 -- # local subsystem config 00:13:15.478 18:01:24 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:13:15.478 { 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme$subsystem", 00:13:15.478 "trtype": "$TEST_TRANSPORT", 00:13:15.478 "traddr": "$NVMF_FIRST_TARGET_IP", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "$NVMF_PORT", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:13:15.478 "hdgst": ${hdgst:-false}, 00:13:15.478 "ddgst": ${ddgst:-false} 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 } 00:13:15.478 EOF 00:13:15.478 )") 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # cat 00:13:15.478 18:01:24 -- target/bdev_io_wait.sh@37 -- # wait 936616 00:13:15.478 18:01:24 -- nvmf/common.sh@543 -- # cat 00:13:15.478 18:01:24 -- nvmf/common.sh@545 -- # jq . 00:13:15.478 18:01:24 -- nvmf/common.sh@545 -- # jq . 00:13:15.478 18:01:24 -- nvmf/common.sh@545 -- # jq . 00:13:15.478 18:01:24 -- nvmf/common.sh@546 -- # IFS=, 00:13:15.478 18:01:24 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme1", 00:13:15.478 "trtype": "rdma", 00:13:15.478 "traddr": "192.168.100.8", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "4420", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:15.478 "hdgst": false, 00:13:15.478 "ddgst": false 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 }' 00:13:15.478 18:01:24 -- nvmf/common.sh@545 -- # jq . 00:13:15.478 18:01:24 -- nvmf/common.sh@546 -- # IFS=, 00:13:15.478 18:01:24 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme1", 00:13:15.478 "trtype": "rdma", 00:13:15.478 "traddr": "192.168.100.8", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "4420", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:15.478 "hdgst": false, 00:13:15.478 "ddgst": false 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 }' 00:13:15.478 18:01:24 -- nvmf/common.sh@546 -- # IFS=, 00:13:15.478 18:01:24 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme1", 00:13:15.478 "trtype": "rdma", 00:13:15.478 "traddr": "192.168.100.8", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "4420", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:15.478 "hdgst": false, 00:13:15.478 "ddgst": false 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 }' 00:13:15.478 18:01:24 -- nvmf/common.sh@546 -- # IFS=, 00:13:15.478 18:01:24 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:13:15.478 "params": { 00:13:15.478 "name": "Nvme1", 00:13:15.478 "trtype": "rdma", 00:13:15.478 "traddr": "192.168.100.8", 00:13:15.478 "adrfam": "ipv4", 00:13:15.478 "trsvcid": "4420", 00:13:15.478 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:13:15.478 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:13:15.478 "hdgst": false, 00:13:15.478 "ddgst": false 00:13:15.478 }, 00:13:15.478 "method": "bdev_nvme_attach_controller" 00:13:15.478 }' 00:13:15.478 [2024-04-26 18:01:24.662964] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:15.478 [2024-04-26 18:01:24.663032] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:13:15.478 [2024-04-26 18:01:24.664670] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:15.478 [2024-04-26 18:01:24.664730] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:13:15.478 [2024-04-26 18:01:24.666018] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:15.478 [2024-04-26 18:01:24.666074] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:13:15.478 [2024-04-26 18:01:24.666473] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:15.478 [2024-04-26 18:01:24.666525] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:13:15.737 EAL: No free 2048 kB hugepages reported on node 1 00:13:15.737 EAL: No free 2048 kB hugepages reported on node 1 00:13:15.737 [2024-04-26 18:01:24.867439] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.005 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.005 [2024-04-26 18:01:24.949330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:13:16.005 [2024-04-26 18:01:24.975895] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.005 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.005 [2024-04-26 18:01:25.057327] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:13:16.005 [2024-04-26 18:01:25.083552] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.005 [2024-04-26 18:01:25.124285] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:16.005 [2024-04-26 18:01:25.177914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:13:16.270 [2024-04-26 18:01:25.206899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:13:16.270 Running I/O for 1 seconds... 00:13:16.270 Running I/O for 1 seconds... 00:13:16.270 Running I/O for 1 seconds... 00:13:16.270 Running I/O for 1 seconds... 00:13:17.211 00:13:17.211 Latency(us) 00:13:17.211 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:17.211 Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:13:17.211 Nvme1n1 : 1.01 17181.06 67.11 0.00 0.00 7427.12 4587.52 13392.14 00:13:17.211 =================================================================================================================== 00:13:17.211 Total : 17181.06 67.11 0.00 0.00 7427.12 4587.52 13392.14 00:13:17.211 00:13:17.211 Latency(us) 00:13:17.211 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:17.211 Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:13:17.211 Nvme1n1 : 1.00 17009.32 66.44 0.00 0.00 7503.74 4815.47 18008.15 00:13:17.211 =================================================================================================================== 00:13:17.211 Total : 17009.32 66.44 0.00 0.00 7503.74 4815.47 18008.15 00:13:17.211 00:13:17.211 Latency(us) 00:13:17.212 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:17.212 Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:13:17.212 Nvme1n1 : 1.00 16035.80 62.64 0.00 0.00 7962.15 3875.17 19831.76 00:13:17.212 =================================================================================================================== 00:13:17.212 Total : 16035.80 62.64 0.00 0.00 7962.15 3875.17 19831.76 00:13:17.212 00:13:17.212 Latency(us) 00:13:17.212 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:17.212 Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:13:17.212 Nvme1n1 : 1.00 261121.85 1020.01 0.00 0.00 488.12 188.77 1894.85 00:13:17.212 =================================================================================================================== 00:13:17.212 Total : 261121.85 1020.01 0.00 0.00 488.12 188.77 1894.85 00:13:17.470 18:01:26 -- target/bdev_io_wait.sh@38 -- # wait 936619 00:13:17.729 18:01:26 -- target/bdev_io_wait.sh@39 -- # wait 936622 00:13:17.729 18:01:26 -- target/bdev_io_wait.sh@40 -- # wait 936625 00:13:17.729 18:01:26 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:17.729 18:01:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:17.729 18:01:26 -- common/autotest_common.sh@10 -- # set +x 00:13:17.729 18:01:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:17.729 18:01:26 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:13:17.729 18:01:26 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:13:17.729 18:01:26 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:17.729 18:01:26 -- nvmf/common.sh@117 -- # sync 00:13:17.729 18:01:26 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:17.729 18:01:26 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:17.729 18:01:26 -- nvmf/common.sh@120 -- # set +e 00:13:17.729 18:01:26 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:17.729 18:01:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:17.729 rmmod nvme_rdma 00:13:17.729 rmmod nvme_fabrics 00:13:17.729 18:01:26 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:17.729 18:01:26 -- nvmf/common.sh@124 -- # set -e 00:13:17.729 18:01:26 -- nvmf/common.sh@125 -- # return 0 00:13:17.729 18:01:26 -- nvmf/common.sh@478 -- # '[' -n 936494 ']' 00:13:17.729 18:01:26 -- nvmf/common.sh@479 -- # killprocess 936494 00:13:17.729 18:01:26 -- common/autotest_common.sh@946 -- # '[' -z 936494 ']' 00:13:17.729 18:01:26 -- common/autotest_common.sh@950 -- # kill -0 936494 00:13:17.729 18:01:26 -- common/autotest_common.sh@951 -- # uname 00:13:17.729 18:01:26 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:17.729 18:01:26 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 936494 00:13:17.729 18:01:26 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:13:17.729 18:01:26 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:13:17.729 18:01:26 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 936494' 00:13:17.729 killing process with pid 936494 00:13:17.729 18:01:26 -- common/autotest_common.sh@965 -- # kill 936494 00:13:17.729 18:01:26 -- common/autotest_common.sh@970 -- # wait 936494 00:13:17.988 [2024-04-26 18:01:26.957781] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:17.988 18:01:27 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:17.988 18:01:27 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:17.988 00:13:17.988 real 0m10.162s 00:13:17.988 user 0m21.748s 00:13:17.988 sys 0m6.245s 00:13:17.988 18:01:27 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:17.988 18:01:27 -- common/autotest_common.sh@10 -- # set +x 00:13:17.988 ************************************ 00:13:17.988 END TEST nvmf_bdev_io_wait 00:13:17.988 ************************************ 00:13:18.248 18:01:27 -- nvmf/nvmf.sh@51 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:13:18.248 18:01:27 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:18.248 18:01:27 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:18.248 18:01:27 -- common/autotest_common.sh@10 -- # set +x 00:13:18.248 ************************************ 00:13:18.248 START TEST nvmf_queue_depth 00:13:18.248 ************************************ 00:13:18.248 18:01:27 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=rdma 00:13:18.506 * Looking for test storage... 00:13:18.506 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:18.506 18:01:27 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:18.506 18:01:27 -- nvmf/common.sh@7 -- # uname -s 00:13:18.506 18:01:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:18.506 18:01:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:18.506 18:01:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:18.506 18:01:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:18.506 18:01:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:18.506 18:01:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:18.506 18:01:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:18.506 18:01:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:18.506 18:01:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:18.506 18:01:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:18.506 18:01:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:18.506 18:01:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:18.506 18:01:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:18.506 18:01:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:18.506 18:01:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:18.506 18:01:27 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:18.506 18:01:27 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:18.506 18:01:27 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:18.506 18:01:27 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:18.506 18:01:27 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:18.506 18:01:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.506 18:01:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.506 18:01:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.506 18:01:27 -- paths/export.sh@5 -- # export PATH 00:13:18.506 18:01:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:18.506 18:01:27 -- nvmf/common.sh@47 -- # : 0 00:13:18.506 18:01:27 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:18.506 18:01:27 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:18.506 18:01:27 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:18.506 18:01:27 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:18.506 18:01:27 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:18.506 18:01:27 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:18.506 18:01:27 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:18.506 18:01:27 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:18.506 18:01:27 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:13:18.506 18:01:27 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:13:18.506 18:01:27 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:13:18.506 18:01:27 -- target/queue_depth.sh@19 -- # nvmftestinit 00:13:18.506 18:01:27 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:18.506 18:01:27 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:18.506 18:01:27 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:18.506 18:01:27 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:18.506 18:01:27 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:18.506 18:01:27 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:18.506 18:01:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:18.506 18:01:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:18.506 18:01:27 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:18.506 18:01:27 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:18.506 18:01:27 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:18.506 18:01:27 -- common/autotest_common.sh@10 -- # set +x 00:13:25.076 18:01:33 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:25.076 18:01:33 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:25.076 18:01:33 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:25.076 18:01:33 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:25.076 18:01:33 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:25.076 18:01:33 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:25.076 18:01:33 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:25.076 18:01:33 -- nvmf/common.sh@295 -- # net_devs=() 00:13:25.076 18:01:33 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:25.076 18:01:33 -- nvmf/common.sh@296 -- # e810=() 00:13:25.076 18:01:33 -- nvmf/common.sh@296 -- # local -ga e810 00:13:25.076 18:01:33 -- nvmf/common.sh@297 -- # x722=() 00:13:25.076 18:01:33 -- nvmf/common.sh@297 -- # local -ga x722 00:13:25.076 18:01:33 -- nvmf/common.sh@298 -- # mlx=() 00:13:25.076 18:01:33 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:25.076 18:01:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:25.076 18:01:33 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:25.076 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:25.076 18:01:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:25.076 18:01:33 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:25.076 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:25.076 18:01:33 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:25.076 18:01:33 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.076 18:01:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.076 18:01:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:25.076 Found net devices under 0000:18:00.0: mlx_0_0 00:13:25.076 18:01:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.076 18:01:33 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.076 18:01:33 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:25.076 Found net devices under 0000:18:00.1: mlx_0_1 00:13:25.076 18:01:33 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.076 18:01:33 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:25.076 18:01:33 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:25.076 18:01:33 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:25.076 18:01:33 -- nvmf/common.sh@58 -- # uname 00:13:25.076 18:01:33 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:25.076 18:01:33 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:25.076 18:01:33 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:25.076 18:01:33 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:25.076 18:01:33 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:25.076 18:01:33 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:25.076 18:01:33 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:25.076 18:01:33 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:25.076 18:01:33 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:25.076 18:01:33 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:25.076 18:01:33 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:25.076 18:01:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:25.076 18:01:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:25.076 18:01:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:25.076 18:01:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:25.076 18:01:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:25.076 18:01:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:25.076 18:01:33 -- nvmf/common.sh@105 -- # continue 2 00:13:25.076 18:01:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.076 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:25.076 18:01:33 -- nvmf/common.sh@105 -- # continue 2 00:13:25.076 18:01:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:25.076 18:01:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:25.076 18:01:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:25.076 18:01:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:25.076 18:01:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:25.076 18:01:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:25.076 18:01:33 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:25.076 18:01:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:25.076 18:01:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:25.076 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:25.076 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:25.077 altname enp24s0f0np0 00:13:25.077 altname ens785f0np0 00:13:25.077 inet 192.168.100.8/24 scope global mlx_0_0 00:13:25.077 valid_lft forever preferred_lft forever 00:13:25.077 18:01:33 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:25.077 18:01:33 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:25.077 18:01:33 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:25.077 18:01:33 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:25.077 18:01:33 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:25.077 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:25.077 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:25.077 altname enp24s0f1np1 00:13:25.077 altname ens785f1np1 00:13:25.077 inet 192.168.100.9/24 scope global mlx_0_1 00:13:25.077 valid_lft forever preferred_lft forever 00:13:25.077 18:01:33 -- nvmf/common.sh@411 -- # return 0 00:13:25.077 18:01:33 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:25.077 18:01:33 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:25.077 18:01:33 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:25.077 18:01:33 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:25.077 18:01:33 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:25.077 18:01:33 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:25.077 18:01:33 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:25.077 18:01:33 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:25.077 18:01:33 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:25.077 18:01:33 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:25.077 18:01:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:25.077 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.077 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:25.077 18:01:33 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:25.077 18:01:33 -- nvmf/common.sh@105 -- # continue 2 00:13:25.077 18:01:33 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:25.077 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.077 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:25.077 18:01:33 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:25.077 18:01:33 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:25.077 18:01:33 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@105 -- # continue 2 00:13:25.077 18:01:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:25.077 18:01:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:25.077 18:01:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:25.077 18:01:33 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:25.077 18:01:33 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:25.077 18:01:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:25.077 18:01:33 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:25.077 192.168.100.9' 00:13:25.077 18:01:33 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:25.077 192.168.100.9' 00:13:25.077 18:01:33 -- nvmf/common.sh@446 -- # head -n 1 00:13:25.077 18:01:33 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:25.077 18:01:33 -- nvmf/common.sh@447 -- # head -n 1 00:13:25.077 18:01:33 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:25.077 192.168.100.9' 00:13:25.077 18:01:33 -- nvmf/common.sh@447 -- # tail -n +2 00:13:25.077 18:01:33 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:25.077 18:01:33 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:25.077 18:01:33 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:25.077 18:01:33 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:25.077 18:01:33 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:25.077 18:01:33 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:25.077 18:01:33 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:13:25.077 18:01:33 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:25.077 18:01:33 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:25.077 18:01:33 -- common/autotest_common.sh@10 -- # set +x 00:13:25.077 18:01:33 -- nvmf/common.sh@470 -- # nvmfpid=939845 00:13:25.077 18:01:33 -- nvmf/common.sh@471 -- # waitforlisten 939845 00:13:25.077 18:01:33 -- common/autotest_common.sh@827 -- # '[' -z 939845 ']' 00:13:25.077 18:01:33 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:25.077 18:01:33 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:25.077 18:01:33 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:25.077 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:25.077 18:01:33 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:25.077 18:01:33 -- common/autotest_common.sh@10 -- # set +x 00:13:25.077 18:01:33 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:25.077 [2024-04-26 18:01:33.691740] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:25.077 [2024-04-26 18:01:33.691799] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:25.077 EAL: No free 2048 kB hugepages reported on node 1 00:13:25.077 [2024-04-26 18:01:33.762471] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:25.077 [2024-04-26 18:01:33.848721] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:25.077 [2024-04-26 18:01:33.848760] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:25.077 [2024-04-26 18:01:33.848769] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:25.077 [2024-04-26 18:01:33.848794] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:25.077 [2024-04-26 18:01:33.848801] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:25.077 [2024-04-26 18:01:33.848830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:25.336 18:01:34 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:25.336 18:01:34 -- common/autotest_common.sh@860 -- # return 0 00:13:25.336 18:01:34 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:25.336 18:01:34 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:25.336 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 18:01:34 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:25.595 18:01:34 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:25.595 18:01:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 [2024-04-26 18:01:34.561483] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xd026e0/0xd06bd0) succeed. 00:13:25.595 [2024-04-26 18:01:34.570258] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xd03be0/0xd48260) succeed. 00:13:25.595 18:01:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:25.595 18:01:34 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:25.595 18:01:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 Malloc0 00:13:25.595 18:01:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:25.595 18:01:34 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:13:25.595 18:01:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 18:01:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:25.595 18:01:34 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:25.595 18:01:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 18:01:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:25.595 18:01:34 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:25.595 18:01:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 [2024-04-26 18:01:34.655554] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:25.595 18:01:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:25.595 18:01:34 -- target/queue_depth.sh@30 -- # bdevperf_pid=940038 00:13:25.595 18:01:34 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:13:25.595 18:01:34 -- target/queue_depth.sh@33 -- # waitforlisten 940038 /var/tmp/bdevperf.sock 00:13:25.595 18:01:34 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:13:25.595 18:01:34 -- common/autotest_common.sh@827 -- # '[' -z 940038 ']' 00:13:25.595 18:01:34 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:13:25.595 18:01:34 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:25.595 18:01:34 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:13:25.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:13:25.595 18:01:34 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:25.595 18:01:34 -- common/autotest_common.sh@10 -- # set +x 00:13:25.595 [2024-04-26 18:01:34.692126] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:25.595 [2024-04-26 18:01:34.692176] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid940038 ] 00:13:25.595 EAL: No free 2048 kB hugepages reported on node 1 00:13:25.595 [2024-04-26 18:01:34.763137] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:25.853 [2024-04-26 18:01:34.853099] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:26.420 18:01:35 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:26.420 18:01:35 -- common/autotest_common.sh@860 -- # return 0 00:13:26.420 18:01:35 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:13:26.420 18:01:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:26.420 18:01:35 -- common/autotest_common.sh@10 -- # set +x 00:13:26.420 NVMe0n1 00:13:26.420 18:01:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:26.420 18:01:35 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:13:26.679 Running I/O for 10 seconds... 00:13:36.669 00:13:36.669 Latency(us) 00:13:36.669 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:36.669 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:13:36.669 Verification LBA range: start 0x0 length 0x4000 00:13:36.669 NVMe0n1 : 10.04 17850.68 69.73 0.00 0.00 57225.18 21883.33 36700.16 00:13:36.669 =================================================================================================================== 00:13:36.669 Total : 17850.68 69.73 0.00 0.00 57225.18 21883.33 36700.16 00:13:36.669 0 00:13:36.669 18:01:45 -- target/queue_depth.sh@39 -- # killprocess 940038 00:13:36.669 18:01:45 -- common/autotest_common.sh@946 -- # '[' -z 940038 ']' 00:13:36.669 18:01:45 -- common/autotest_common.sh@950 -- # kill -0 940038 00:13:36.669 18:01:45 -- common/autotest_common.sh@951 -- # uname 00:13:36.669 18:01:45 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:36.669 18:01:45 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 940038 00:13:36.669 18:01:45 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:13:36.669 18:01:45 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:13:36.669 18:01:45 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 940038' 00:13:36.669 killing process with pid 940038 00:13:36.669 18:01:45 -- common/autotest_common.sh@965 -- # kill 940038 00:13:36.669 Received shutdown signal, test time was about 10.000000 seconds 00:13:36.669 00:13:36.669 Latency(us) 00:13:36.669 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:13:36.669 =================================================================================================================== 00:13:36.669 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:13:36.669 18:01:45 -- common/autotest_common.sh@970 -- # wait 940038 00:13:36.927 18:01:46 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:36.927 18:01:46 -- target/queue_depth.sh@43 -- # nvmftestfini 00:13:36.927 18:01:46 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:36.927 18:01:46 -- nvmf/common.sh@117 -- # sync 00:13:36.927 18:01:46 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:36.927 18:01:46 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:36.927 18:01:46 -- nvmf/common.sh@120 -- # set +e 00:13:36.927 18:01:46 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:36.927 18:01:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:36.927 rmmod nvme_rdma 00:13:36.927 rmmod nvme_fabrics 00:13:37.185 18:01:46 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:37.185 18:01:46 -- nvmf/common.sh@124 -- # set -e 00:13:37.185 18:01:46 -- nvmf/common.sh@125 -- # return 0 00:13:37.185 18:01:46 -- nvmf/common.sh@478 -- # '[' -n 939845 ']' 00:13:37.185 18:01:46 -- nvmf/common.sh@479 -- # killprocess 939845 00:13:37.185 18:01:46 -- common/autotest_common.sh@946 -- # '[' -z 939845 ']' 00:13:37.185 18:01:46 -- common/autotest_common.sh@950 -- # kill -0 939845 00:13:37.185 18:01:46 -- common/autotest_common.sh@951 -- # uname 00:13:37.185 18:01:46 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:37.185 18:01:46 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 939845 00:13:37.185 18:01:46 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:13:37.185 18:01:46 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:13:37.185 18:01:46 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 939845' 00:13:37.185 killing process with pid 939845 00:13:37.185 18:01:46 -- common/autotest_common.sh@965 -- # kill 939845 00:13:37.185 18:01:46 -- common/autotest_common.sh@970 -- # wait 939845 00:13:37.185 [2024-04-26 18:01:46.224978] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:13:37.444 18:01:46 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:37.444 18:01:46 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:37.444 00:13:37.444 real 0m19.108s 00:13:37.444 user 0m26.188s 00:13:37.444 sys 0m5.362s 00:13:37.444 18:01:46 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:37.444 18:01:46 -- common/autotest_common.sh@10 -- # set +x 00:13:37.444 ************************************ 00:13:37.444 END TEST nvmf_queue_depth 00:13:37.444 ************************************ 00:13:37.444 18:01:46 -- nvmf/nvmf.sh@52 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:13:37.444 18:01:46 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:37.444 18:01:46 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:37.444 18:01:46 -- common/autotest_common.sh@10 -- # set +x 00:13:37.703 ************************************ 00:13:37.703 START TEST nvmf_multipath 00:13:37.703 ************************************ 00:13:37.703 18:01:46 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=rdma 00:13:37.703 * Looking for test storage... 00:13:37.703 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:37.703 18:01:46 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.703 18:01:46 -- nvmf/common.sh@7 -- # uname -s 00:13:37.703 18:01:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.703 18:01:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.703 18:01:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.703 18:01:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.703 18:01:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.703 18:01:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.703 18:01:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.703 18:01:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.703 18:01:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.703 18:01:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.703 18:01:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:37.703 18:01:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:37.703 18:01:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.703 18:01:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.703 18:01:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.703 18:01:46 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:37.703 18:01:46 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:37.703 18:01:46 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.703 18:01:46 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.703 18:01:46 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.703 18:01:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.704 18:01:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.704 18:01:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.704 18:01:46 -- paths/export.sh@5 -- # export PATH 00:13:37.704 18:01:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.704 18:01:46 -- nvmf/common.sh@47 -- # : 0 00:13:37.704 18:01:46 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:37.704 18:01:46 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:37.704 18:01:46 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:37.704 18:01:46 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.704 18:01:46 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.704 18:01:46 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:37.704 18:01:46 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:37.704 18:01:46 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:37.704 18:01:46 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:37.704 18:01:46 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:37.704 18:01:46 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:13:37.704 18:01:46 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:13:37.704 18:01:46 -- target/multipath.sh@43 -- # nvmftestinit 00:13:37.704 18:01:46 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:37.704 18:01:46 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.704 18:01:46 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:37.704 18:01:46 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:37.704 18:01:46 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:37.704 18:01:46 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.704 18:01:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.704 18:01:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.704 18:01:46 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:37.704 18:01:46 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:37.704 18:01:46 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:37.704 18:01:46 -- common/autotest_common.sh@10 -- # set +x 00:13:42.981 18:01:52 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:42.981 18:01:52 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:42.981 18:01:52 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:42.981 18:01:52 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:42.981 18:01:52 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:42.981 18:01:52 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:42.981 18:01:52 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:42.981 18:01:52 -- nvmf/common.sh@295 -- # net_devs=() 00:13:42.981 18:01:52 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:42.981 18:01:52 -- nvmf/common.sh@296 -- # e810=() 00:13:42.981 18:01:52 -- nvmf/common.sh@296 -- # local -ga e810 00:13:42.981 18:01:52 -- nvmf/common.sh@297 -- # x722=() 00:13:42.981 18:01:52 -- nvmf/common.sh@297 -- # local -ga x722 00:13:42.981 18:01:52 -- nvmf/common.sh@298 -- # mlx=() 00:13:42.981 18:01:52 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:42.981 18:01:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:42.981 18:01:52 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:42.981 18:01:52 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:42.981 18:01:52 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:42.981 18:01:52 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:42.981 18:01:52 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:42.982 18:01:52 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:42.982 18:01:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.982 18:01:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:42.982 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:42.982 18:01:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.982 18:01:52 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:42.982 18:01:52 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:42.982 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:42.982 18:01:52 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:42.982 18:01:52 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:42.982 18:01:52 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.982 18:01:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.982 18:01:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.982 18:01:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.982 18:01:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:42.982 Found net devices under 0000:18:00.0: mlx_0_0 00:13:42.982 18:01:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:42.982 18:01:52 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:42.982 18:01:52 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:42.982 18:01:52 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:42.982 18:01:52 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:42.982 Found net devices under 0000:18:00.1: mlx_0_1 00:13:42.982 18:01:52 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:42.982 18:01:52 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:42.982 18:01:52 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:42.982 18:01:52 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:42.982 18:01:52 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:42.982 18:01:52 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:42.982 18:01:52 -- nvmf/common.sh@58 -- # uname 00:13:42.982 18:01:52 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:42.982 18:01:52 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:42.982 18:01:52 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:42.982 18:01:52 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:42.982 18:01:52 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:43.243 18:01:52 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:43.243 18:01:52 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:43.243 18:01:52 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:43.243 18:01:52 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:43.243 18:01:52 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:43.243 18:01:52 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:43.243 18:01:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:43.243 18:01:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:43.243 18:01:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:43.243 18:01:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:43.243 18:01:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:43.243 18:01:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:43.243 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.243 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:43.243 18:01:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:43.243 18:01:52 -- nvmf/common.sh@105 -- # continue 2 00:13:43.243 18:01:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:43.243 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.243 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:43.243 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.243 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:43.243 18:01:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:43.243 18:01:52 -- nvmf/common.sh@105 -- # continue 2 00:13:43.243 18:01:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:43.243 18:01:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:43.243 18:01:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:43.243 18:01:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:43.243 18:01:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:43.243 18:01:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:43.243 18:01:52 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:43.243 18:01:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:43.243 18:01:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:43.243 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:43.244 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:43.244 altname enp24s0f0np0 00:13:43.244 altname ens785f0np0 00:13:43.244 inet 192.168.100.8/24 scope global mlx_0_0 00:13:43.244 valid_lft forever preferred_lft forever 00:13:43.244 18:01:52 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:43.244 18:01:52 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:43.244 18:01:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:43.244 18:01:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:43.244 18:01:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:43.244 18:01:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:43.244 18:01:52 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:43.244 18:01:52 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:43.244 18:01:52 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:43.244 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:43.244 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:43.244 altname enp24s0f1np1 00:13:43.244 altname ens785f1np1 00:13:43.244 inet 192.168.100.9/24 scope global mlx_0_1 00:13:43.244 valid_lft forever preferred_lft forever 00:13:43.244 18:01:52 -- nvmf/common.sh@411 -- # return 0 00:13:43.244 18:01:52 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:43.244 18:01:52 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:43.244 18:01:52 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:43.244 18:01:52 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:43.244 18:01:52 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:43.244 18:01:52 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:43.244 18:01:52 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:43.244 18:01:52 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:43.244 18:01:52 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:43.244 18:01:52 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:43.244 18:01:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:43.244 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.244 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:43.244 18:01:52 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:43.244 18:01:52 -- nvmf/common.sh@105 -- # continue 2 00:13:43.244 18:01:52 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:43.245 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.245 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:43.245 18:01:52 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:43.245 18:01:52 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:43.245 18:01:52 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:43.245 18:01:52 -- nvmf/common.sh@105 -- # continue 2 00:13:43.245 18:01:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:43.245 18:01:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:43.245 18:01:52 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:43.245 18:01:52 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:43.245 18:01:52 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:43.245 18:01:52 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:43.245 18:01:52 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:43.245 18:01:52 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:43.245 192.168.100.9' 00:13:43.245 18:01:52 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:43.245 192.168.100.9' 00:13:43.245 18:01:52 -- nvmf/common.sh@446 -- # head -n 1 00:13:43.245 18:01:52 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:43.245 18:01:52 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:43.245 192.168.100.9' 00:13:43.245 18:01:52 -- nvmf/common.sh@447 -- # tail -n +2 00:13:43.245 18:01:52 -- nvmf/common.sh@447 -- # head -n 1 00:13:43.245 18:01:52 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:43.245 18:01:52 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:43.245 18:01:52 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:43.245 18:01:52 -- target/multipath.sh@45 -- # '[' -z 192.168.100.9 ']' 00:13:43.245 18:01:52 -- target/multipath.sh@51 -- # '[' rdma '!=' tcp ']' 00:13:43.245 18:01:52 -- target/multipath.sh@52 -- # echo 'run this test only with TCP transport for now' 00:13:43.245 run this test only with TCP transport for now 00:13:43.245 18:01:52 -- target/multipath.sh@53 -- # nvmftestfini 00:13:43.245 18:01:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:43.245 18:01:52 -- nvmf/common.sh@117 -- # sync 00:13:43.245 18:01:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@120 -- # set +e 00:13:43.245 18:01:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:43.245 18:01:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:43.245 rmmod nvme_rdma 00:13:43.245 rmmod nvme_fabrics 00:13:43.245 18:01:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:43.245 18:01:52 -- nvmf/common.sh@124 -- # set -e 00:13:43.245 18:01:52 -- nvmf/common.sh@125 -- # return 0 00:13:43.245 18:01:52 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:43.245 18:01:52 -- target/multipath.sh@54 -- # exit 0 00:13:43.245 18:01:52 -- target/multipath.sh@1 -- # nvmftestfini 00:13:43.245 18:01:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:43.245 18:01:52 -- nvmf/common.sh@117 -- # sync 00:13:43.245 18:01:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@120 -- # set +e 00:13:43.245 18:01:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:43.245 18:01:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:43.245 18:01:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:43.245 18:01:52 -- nvmf/common.sh@124 -- # set -e 00:13:43.245 18:01:52 -- nvmf/common.sh@125 -- # return 0 00:13:43.245 18:01:52 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:43.245 18:01:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:43.245 00:13:43.245 real 0m5.751s 00:13:43.245 user 0m1.580s 00:13:43.245 sys 0m4.263s 00:13:43.245 18:01:52 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:43.245 18:01:52 -- common/autotest_common.sh@10 -- # set +x 00:13:43.245 ************************************ 00:13:43.245 END TEST nvmf_multipath 00:13:43.245 ************************************ 00:13:43.507 18:01:52 -- nvmf/nvmf.sh@53 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:13:43.507 18:01:52 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:43.507 18:01:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:43.507 18:01:52 -- common/autotest_common.sh@10 -- # set +x 00:13:43.507 ************************************ 00:13:43.507 START TEST nvmf_zcopy 00:13:43.507 ************************************ 00:13:43.507 18:01:52 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=rdma 00:13:43.766 * Looking for test storage... 00:13:43.766 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:43.766 18:01:52 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.766 18:01:52 -- nvmf/common.sh@7 -- # uname -s 00:13:43.766 18:01:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.766 18:01:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.766 18:01:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.766 18:01:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.766 18:01:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.766 18:01:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.766 18:01:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.766 18:01:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.766 18:01:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.766 18:01:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.766 18:01:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:43.766 18:01:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:43.766 18:01:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.766 18:01:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.766 18:01:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.766 18:01:52 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:43.766 18:01:52 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:43.766 18:01:52 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.766 18:01:52 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.766 18:01:52 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.766 18:01:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.766 18:01:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.766 18:01:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.766 18:01:52 -- paths/export.sh@5 -- # export PATH 00:13:43.767 18:01:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.767 18:01:52 -- nvmf/common.sh@47 -- # : 0 00:13:43.767 18:01:52 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:43.767 18:01:52 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:43.767 18:01:52 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:43.767 18:01:52 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.767 18:01:52 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.767 18:01:52 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:43.767 18:01:52 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:43.767 18:01:52 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:43.767 18:01:52 -- target/zcopy.sh@12 -- # nvmftestinit 00:13:43.767 18:01:52 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:43.767 18:01:52 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.767 18:01:52 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:43.767 18:01:52 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:43.767 18:01:52 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:43.767 18:01:52 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.767 18:01:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.767 18:01:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.767 18:01:52 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:43.767 18:01:52 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:43.767 18:01:52 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:43.767 18:01:52 -- common/autotest_common.sh@10 -- # set +x 00:13:50.424 18:01:58 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:50.424 18:01:58 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:50.424 18:01:58 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:50.424 18:01:58 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:50.424 18:01:58 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:50.424 18:01:58 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:50.424 18:01:58 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:50.424 18:01:58 -- nvmf/common.sh@295 -- # net_devs=() 00:13:50.424 18:01:58 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:50.424 18:01:58 -- nvmf/common.sh@296 -- # e810=() 00:13:50.424 18:01:58 -- nvmf/common.sh@296 -- # local -ga e810 00:13:50.424 18:01:58 -- nvmf/common.sh@297 -- # x722=() 00:13:50.424 18:01:58 -- nvmf/common.sh@297 -- # local -ga x722 00:13:50.424 18:01:58 -- nvmf/common.sh@298 -- # mlx=() 00:13:50.424 18:01:58 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:50.424 18:01:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:50.424 18:01:58 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:50.424 18:01:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:50.424 18:01:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:50.424 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:50.424 18:01:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:50.424 18:01:58 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:50.424 18:01:58 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:50.424 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:50.424 18:01:58 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:50.424 18:01:58 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:50.424 18:01:58 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:50.424 18:01:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.424 18:01:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:50.424 18:01:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.424 18:01:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:50.424 Found net devices under 0000:18:00.0: mlx_0_0 00:13:50.424 18:01:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:50.424 18:01:58 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:50.424 18:01:58 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:50.424 18:01:58 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:50.424 18:01:58 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:50.424 Found net devices under 0000:18:00.1: mlx_0_1 00:13:50.424 18:01:58 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:50.424 18:01:58 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:50.424 18:01:58 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:50.424 18:01:58 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:50.424 18:01:58 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:50.424 18:01:58 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:50.424 18:01:58 -- nvmf/common.sh@58 -- # uname 00:13:50.424 18:01:58 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:50.424 18:01:58 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:50.424 18:01:58 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:50.424 18:01:58 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:50.424 18:01:58 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:50.424 18:01:58 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:50.424 18:01:58 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:50.424 18:01:58 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:50.424 18:01:58 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:50.424 18:01:58 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:50.425 18:01:58 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:50.425 18:01:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:50.425 18:01:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:50.425 18:01:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:50.425 18:01:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:50.425 18:01:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:50.425 18:01:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@105 -- # continue 2 00:13:50.425 18:01:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@105 -- # continue 2 00:13:50.425 18:01:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:50.425 18:01:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.425 18:01:58 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:50.425 18:01:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:50.425 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:50.425 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:50.425 altname enp24s0f0np0 00:13:50.425 altname ens785f0np0 00:13:50.425 inet 192.168.100.8/24 scope global mlx_0_0 00:13:50.425 valid_lft forever preferred_lft forever 00:13:50.425 18:01:58 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:50.425 18:01:58 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.425 18:01:58 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:50.425 18:01:58 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:50.425 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:50.425 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:50.425 altname enp24s0f1np1 00:13:50.425 altname ens785f1np1 00:13:50.425 inet 192.168.100.9/24 scope global mlx_0_1 00:13:50.425 valid_lft forever preferred_lft forever 00:13:50.425 18:01:58 -- nvmf/common.sh@411 -- # return 0 00:13:50.425 18:01:58 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:50.425 18:01:58 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:50.425 18:01:58 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:50.425 18:01:58 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:50.425 18:01:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:50.425 18:01:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:50.425 18:01:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:50.425 18:01:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:50.425 18:01:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:50.425 18:01:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@105 -- # continue 2 00:13:50.425 18:01:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:50.425 18:01:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:50.425 18:01:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@105 -- # continue 2 00:13:50.425 18:01:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:50.425 18:01:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.425 18:01:58 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:50.425 18:01:58 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:50.425 18:01:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:50.425 18:01:58 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:50.425 192.168.100.9' 00:13:50.425 18:01:58 -- nvmf/common.sh@446 -- # head -n 1 00:13:50.425 18:01:58 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:50.425 192.168.100.9' 00:13:50.425 18:01:58 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:50.425 18:01:58 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:50.425 192.168.100.9' 00:13:50.425 18:01:58 -- nvmf/common.sh@447 -- # tail -n +2 00:13:50.425 18:01:58 -- nvmf/common.sh@447 -- # head -n 1 00:13:50.425 18:01:58 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:50.425 18:01:58 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:50.425 18:01:58 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:50.425 18:01:58 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:50.425 18:01:58 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:50.425 18:01:58 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:50.425 18:01:58 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:13:50.425 18:01:58 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:50.425 18:01:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:50.425 18:01:58 -- common/autotest_common.sh@10 -- # set +x 00:13:50.425 18:01:58 -- nvmf/common.sh@470 -- # nvmfpid=947130 00:13:50.425 18:01:58 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:50.425 18:01:58 -- nvmf/common.sh@471 -- # waitforlisten 947130 00:13:50.425 18:01:58 -- common/autotest_common.sh@827 -- # '[' -z 947130 ']' 00:13:50.425 18:01:58 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:50.425 18:01:58 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:50.425 18:01:58 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:50.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:50.425 18:01:58 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:50.425 18:01:58 -- common/autotest_common.sh@10 -- # set +x 00:13:50.425 [2024-04-26 18:01:58.733137] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:50.425 [2024-04-26 18:01:58.733195] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:50.425 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.425 [2024-04-26 18:01:58.805420] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:50.425 [2024-04-26 18:01:58.889674] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:50.425 [2024-04-26 18:01:58.889712] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:50.425 [2024-04-26 18:01:58.889722] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:50.425 [2024-04-26 18:01:58.889747] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:50.425 [2024-04-26 18:01:58.889754] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:50.425 [2024-04-26 18:01:58.889783] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.425 18:01:59 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:50.425 18:01:59 -- common/autotest_common.sh@860 -- # return 0 00:13:50.425 18:01:59 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:50.425 18:01:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:50.425 18:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:50.425 18:01:59 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.425 18:01:59 -- target/zcopy.sh@15 -- # '[' rdma '!=' tcp ']' 00:13:50.425 18:01:59 -- target/zcopy.sh@16 -- # echo 'Unsupported transport: rdma' 00:13:50.425 Unsupported transport: rdma 00:13:50.425 18:01:59 -- target/zcopy.sh@17 -- # exit 0 00:13:50.425 18:01:59 -- target/zcopy.sh@1 -- # process_shm --id 0 00:13:50.425 18:01:59 -- common/autotest_common.sh@804 -- # type=--id 00:13:50.425 18:01:59 -- common/autotest_common.sh@805 -- # id=0 00:13:50.425 18:01:59 -- common/autotest_common.sh@806 -- # '[' --id = --pid ']' 00:13:50.425 18:01:59 -- common/autotest_common.sh@810 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:13:50.425 18:01:59 -- common/autotest_common.sh@810 -- # shm_files=nvmf_trace.0 00:13:50.425 18:01:59 -- common/autotest_common.sh@812 -- # [[ -z nvmf_trace.0 ]] 00:13:50.425 18:01:59 -- common/autotest_common.sh@816 -- # for n in $shm_files 00:13:50.425 18:01:59 -- common/autotest_common.sh@817 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:13:50.425 nvmf_trace.0 00:13:50.683 18:01:59 -- common/autotest_common.sh@819 -- # return 0 00:13:50.684 18:01:59 -- target/zcopy.sh@1 -- # nvmftestfini 00:13:50.684 18:01:59 -- nvmf/common.sh@477 -- # nvmfcleanup 00:13:50.684 18:01:59 -- nvmf/common.sh@117 -- # sync 00:13:50.684 18:01:59 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:13:50.684 18:01:59 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:13:50.684 18:01:59 -- nvmf/common.sh@120 -- # set +e 00:13:50.684 18:01:59 -- nvmf/common.sh@121 -- # for i in {1..20} 00:13:50.684 18:01:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:13:50.684 rmmod nvme_rdma 00:13:50.684 rmmod nvme_fabrics 00:13:50.684 18:01:59 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:13:50.684 18:01:59 -- nvmf/common.sh@124 -- # set -e 00:13:50.684 18:01:59 -- nvmf/common.sh@125 -- # return 0 00:13:50.684 18:01:59 -- nvmf/common.sh@478 -- # '[' -n 947130 ']' 00:13:50.684 18:01:59 -- nvmf/common.sh@479 -- # killprocess 947130 00:13:50.684 18:01:59 -- common/autotest_common.sh@946 -- # '[' -z 947130 ']' 00:13:50.684 18:01:59 -- common/autotest_common.sh@950 -- # kill -0 947130 00:13:50.684 18:01:59 -- common/autotest_common.sh@951 -- # uname 00:13:50.684 18:01:59 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:13:50.684 18:01:59 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 947130 00:13:50.684 18:01:59 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:13:50.684 18:01:59 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:13:50.684 18:01:59 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 947130' 00:13:50.684 killing process with pid 947130 00:13:50.684 18:01:59 -- common/autotest_common.sh@965 -- # kill 947130 00:13:50.684 18:01:59 -- common/autotest_common.sh@970 -- # wait 947130 00:13:50.942 18:01:59 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:13:50.942 18:01:59 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:13:50.942 00:13:50.942 real 0m7.321s 00:13:50.942 user 0m3.232s 00:13:50.942 sys 0m4.807s 00:13:50.942 18:01:59 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:13:50.942 18:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:50.942 ************************************ 00:13:50.942 END TEST nvmf_zcopy 00:13:50.942 ************************************ 00:13:50.942 18:01:59 -- nvmf/nvmf.sh@54 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:13:50.942 18:01:59 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:13:50.942 18:01:59 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:13:50.942 18:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:50.942 ************************************ 00:13:50.942 START TEST nvmf_nmic 00:13:50.942 ************************************ 00:13:50.942 18:02:00 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=rdma 00:13:51.202 * Looking for test storage... 00:13:51.202 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:13:51.202 18:02:00 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:13:51.202 18:02:00 -- nvmf/common.sh@7 -- # uname -s 00:13:51.202 18:02:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.202 18:02:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.202 18:02:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.202 18:02:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.202 18:02:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.202 18:02:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.202 18:02:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.202 18:02:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.202 18:02:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.202 18:02:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.202 18:02:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:13:51.202 18:02:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:13:51.202 18:02:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.202 18:02:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.202 18:02:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:51.202 18:02:00 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:13:51.202 18:02:00 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:13:51.202 18:02:00 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.202 18:02:00 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.202 18:02:00 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.202 18:02:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.202 18:02:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.202 18:02:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.202 18:02:00 -- paths/export.sh@5 -- # export PATH 00:13:51.202 18:02:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.202 18:02:00 -- nvmf/common.sh@47 -- # : 0 00:13:51.202 18:02:00 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:13:51.202 18:02:00 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:13:51.202 18:02:00 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:13:51.202 18:02:00 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.202 18:02:00 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.202 18:02:00 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:13:51.202 18:02:00 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:13:51.202 18:02:00 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:13:51.202 18:02:00 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:51.202 18:02:00 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:13:51.202 18:02:00 -- target/nmic.sh@14 -- # nvmftestinit 00:13:51.202 18:02:00 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:13:51.202 18:02:00 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:51.202 18:02:00 -- nvmf/common.sh@437 -- # prepare_net_devs 00:13:51.202 18:02:00 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:13:51.202 18:02:00 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:13:51.202 18:02:00 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.202 18:02:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.202 18:02:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.202 18:02:00 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:13:51.203 18:02:00 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:13:51.203 18:02:00 -- nvmf/common.sh@285 -- # xtrace_disable 00:13:51.203 18:02:00 -- common/autotest_common.sh@10 -- # set +x 00:13:57.777 18:02:06 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.777 18:02:06 -- nvmf/common.sh@291 -- # pci_devs=() 00:13:57.777 18:02:06 -- nvmf/common.sh@291 -- # local -a pci_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:13:57.778 18:02:06 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@293 -- # pci_drivers=() 00:13:57.778 18:02:06 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:13:57.778 18:02:06 -- nvmf/common.sh@295 -- # net_devs=() 00:13:57.778 18:02:06 -- nvmf/common.sh@295 -- # local -ga net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@296 -- # e810=() 00:13:57.778 18:02:06 -- nvmf/common.sh@296 -- # local -ga e810 00:13:57.778 18:02:06 -- nvmf/common.sh@297 -- # x722=() 00:13:57.778 18:02:06 -- nvmf/common.sh@297 -- # local -ga x722 00:13:57.778 18:02:06 -- nvmf/common.sh@298 -- # mlx=() 00:13:57.778 18:02:06 -- nvmf/common.sh@298 -- # local -ga mlx 00:13:57.778 18:02:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.778 18:02:06 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:13:57.778 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:13:57.778 18:02:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:57.778 18:02:06 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:13:57.778 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:13:57.778 18:02:06 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:13:57.778 18:02:06 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.778 18:02:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.778 18:02:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:13:57.778 Found net devices under 0000:18:00.0: mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.778 18:02:06 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.778 18:02:06 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:13:57.778 Found net devices under 0000:18:00.1: mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.778 18:02:06 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@403 -- # is_hw=yes 00:13:57.778 18:02:06 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@409 -- # rdma_device_init 00:13:57.778 18:02:06 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:13:57.778 18:02:06 -- nvmf/common.sh@58 -- # uname 00:13:57.778 18:02:06 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:13:57.778 18:02:06 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:13:57.778 18:02:06 -- nvmf/common.sh@63 -- # modprobe ib_core 00:13:57.778 18:02:06 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:13:57.778 18:02:06 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:13:57.778 18:02:06 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:13:57.778 18:02:06 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:13:57.778 18:02:06 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:13:57.778 18:02:06 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:13:57.778 18:02:06 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:13:57.778 18:02:06 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:13:57.778 18:02:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:57.778 18:02:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:57.778 18:02:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@105 -- # continue 2 00:13:57.778 18:02:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@105 -- # continue 2 00:13:57.778 18:02:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:57.778 18:02:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:57.778 18:02:06 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:13:57.778 18:02:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:13:57.778 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:57.778 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:13:57.778 altname enp24s0f0np0 00:13:57.778 altname ens785f0np0 00:13:57.778 inet 192.168.100.8/24 scope global mlx_0_0 00:13:57.778 valid_lft forever preferred_lft forever 00:13:57.778 18:02:06 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:13:57.778 18:02:06 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:57.778 18:02:06 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:13:57.778 18:02:06 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:13:57.778 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:13:57.778 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:13:57.778 altname enp24s0f1np1 00:13:57.778 altname ens785f1np1 00:13:57.778 inet 192.168.100.9/24 scope global mlx_0_1 00:13:57.778 valid_lft forever preferred_lft forever 00:13:57.778 18:02:06 -- nvmf/common.sh@411 -- # return 0 00:13:57.778 18:02:06 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:13:57.778 18:02:06 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:13:57.778 18:02:06 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:13:57.778 18:02:06 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:13:57.778 18:02:06 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:13:57.778 18:02:06 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:13:57.778 18:02:06 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:13:57.778 18:02:06 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:13:57.778 18:02:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@105 -- # continue 2 00:13:57.778 18:02:06 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:13:57.778 18:02:06 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:13:57.778 18:02:06 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:13:57.778 18:02:06 -- nvmf/common.sh@105 -- # continue 2 00:13:57.778 18:02:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:57.778 18:02:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:13:57.778 18:02:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:57.779 18:02:06 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:13:57.779 18:02:06 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:13:57.779 18:02:06 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:13:57.779 18:02:06 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:13:57.779 18:02:06 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:13:57.779 18:02:06 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:13:57.779 18:02:06 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:13:57.779 192.168.100.9' 00:13:57.779 18:02:06 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:13:57.779 192.168.100.9' 00:13:57.779 18:02:06 -- nvmf/common.sh@446 -- # head -n 1 00:13:57.779 18:02:06 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:13:57.779 18:02:06 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:13:57.779 192.168.100.9' 00:13:57.779 18:02:06 -- nvmf/common.sh@447 -- # tail -n +2 00:13:57.779 18:02:06 -- nvmf/common.sh@447 -- # head -n 1 00:13:57.779 18:02:06 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:13:57.779 18:02:06 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:13:57.779 18:02:06 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:13:57.779 18:02:06 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:13:57.779 18:02:06 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:13:57.779 18:02:06 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:13:57.779 18:02:06 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:13:57.779 18:02:06 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:13:57.779 18:02:06 -- common/autotest_common.sh@720 -- # xtrace_disable 00:13:57.779 18:02:06 -- common/autotest_common.sh@10 -- # set +x 00:13:57.779 18:02:06 -- nvmf/common.sh@470 -- # nvmfpid=950237 00:13:57.779 18:02:06 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:57.779 18:02:06 -- nvmf/common.sh@471 -- # waitforlisten 950237 00:13:57.779 18:02:06 -- common/autotest_common.sh@827 -- # '[' -z 950237 ']' 00:13:57.779 18:02:06 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.779 18:02:06 -- common/autotest_common.sh@832 -- # local max_retries=100 00:13:57.779 18:02:06 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.779 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.779 18:02:06 -- common/autotest_common.sh@836 -- # xtrace_disable 00:13:57.779 18:02:06 -- common/autotest_common.sh@10 -- # set +x 00:13:57.779 [2024-04-26 18:02:06.933126] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:13:57.779 [2024-04-26 18:02:06.933191] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.779 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.037 [2024-04-26 18:02:07.004051] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:58.037 [2024-04-26 18:02:07.091582] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:58.037 [2024-04-26 18:02:07.091618] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:58.037 [2024-04-26 18:02:07.091629] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:13:58.037 [2024-04-26 18:02:07.091638] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:13:58.037 [2024-04-26 18:02:07.091645] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:58.037 [2024-04-26 18:02:07.091693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:58.037 [2024-04-26 18:02:07.091796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:58.037 [2024-04-26 18:02:07.091873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:58.037 [2024-04-26 18:02:07.091875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.604 18:02:07 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:13:58.604 18:02:07 -- common/autotest_common.sh@860 -- # return 0 00:13:58.604 18:02:07 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:13:58.604 18:02:07 -- common/autotest_common.sh@726 -- # xtrace_disable 00:13:58.604 18:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:58.604 18:02:07 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.604 18:02:07 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:13:58.604 18:02:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.604 18:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 [2024-04-26 18:02:07.812742] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x6004d0/0x6049c0) succeed. 00:13:58.864 [2024-04-26 18:02:07.823219] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x601b10/0x646050) succeed. 00:13:58.864 18:02:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:07 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:13:58.864 18:02:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 Malloc0 00:13:58.864 18:02:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:07 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:58.864 18:02:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 18:02:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:07 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:13:58.864 18:02:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 18:02:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:07 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:13:58.864 18:02:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:08 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 [2024-04-26 18:02:08.003441] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:13:58.864 18:02:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:08 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:13:58.864 test case1: single bdev can't be used in multiple subsystems 00:13:58.864 18:02:08 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:13:58.864 18:02:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:08 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 18:02:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:08 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:13:58.864 18:02:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:08 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 18:02:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:08 -- target/nmic.sh@28 -- # nmic_status=0 00:13:58.864 18:02:08 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:13:58.864 18:02:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:08 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 [2024-04-26 18:02:08.027203] bdev.c:8005:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:13:58.864 [2024-04-26 18:02:08.027225] subsystem.c:1940:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:13:58.864 [2024-04-26 18:02:08.027235] nvmf_rpc.c:1534:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:13:58.864 request: 00:13:58.864 { 00:13:58.864 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:13:58.864 "namespace": { 00:13:58.864 "bdev_name": "Malloc0", 00:13:58.864 "no_auto_visible": false 00:13:58.864 }, 00:13:58.864 "method": "nvmf_subsystem_add_ns", 00:13:58.864 "req_id": 1 00:13:58.864 } 00:13:58.864 Got JSON-RPC error response 00:13:58.864 response: 00:13:58.864 { 00:13:58.864 "code": -32602, 00:13:58.864 "message": "Invalid parameters" 00:13:58.864 } 00:13:58.864 18:02:08 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:13:58.864 18:02:08 -- target/nmic.sh@29 -- # nmic_status=1 00:13:58.864 18:02:08 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:13:58.864 18:02:08 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:13:58.864 Adding namespace failed - expected result. 00:13:58.864 18:02:08 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:13:58.864 test case2: host connect to nvmf target in multiple paths 00:13:58.864 18:02:08 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:13:58.864 18:02:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:13:58.864 18:02:08 -- common/autotest_common.sh@10 -- # set +x 00:13:58.864 [2024-04-26 18:02:08.039271] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:13:58.864 18:02:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:13:58.864 18:02:08 -- target/nmic.sh@41 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:00.241 18:02:09 -- target/nmic.sh@42 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4421 00:14:00.808 18:02:09 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:14:00.808 18:02:09 -- common/autotest_common.sh@1194 -- # local i=0 00:14:00.808 18:02:09 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:14:00.808 18:02:09 -- common/autotest_common.sh@1196 -- # [[ -n '' ]] 00:14:00.808 18:02:09 -- common/autotest_common.sh@1201 -- # sleep 2 00:14:03.348 18:02:11 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:14:03.348 18:02:11 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:14:03.348 18:02:11 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:14:03.348 18:02:11 -- common/autotest_common.sh@1203 -- # nvme_devices=1 00:14:03.348 18:02:11 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:14:03.348 18:02:11 -- common/autotest_common.sh@1204 -- # return 0 00:14:03.348 18:02:11 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:14:03.348 [global] 00:14:03.348 thread=1 00:14:03.348 invalidate=1 00:14:03.348 rw=write 00:14:03.348 time_based=1 00:14:03.348 runtime=1 00:14:03.348 ioengine=libaio 00:14:03.348 direct=1 00:14:03.348 bs=4096 00:14:03.348 iodepth=1 00:14:03.348 norandommap=0 00:14:03.348 numjobs=1 00:14:03.348 00:14:03.348 verify_dump=1 00:14:03.348 verify_backlog=512 00:14:03.348 verify_state_save=0 00:14:03.348 do_verify=1 00:14:03.348 verify=crc32c-intel 00:14:03.348 [job0] 00:14:03.348 filename=/dev/nvme0n1 00:14:03.348 Could not set queue depth (nvme0n1) 00:14:03.348 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:03.348 fio-3.35 00:14:03.348 Starting 1 thread 00:14:04.283 00:14:04.283 job0: (groupid=0, jobs=1): err= 0: pid=951097: Fri Apr 26 18:02:13 2024 00:14:04.283 read: IOPS=6649, BW=26.0MiB/s (27.2MB/s)(26.0MiB/1001msec) 00:14:04.283 slat (nsec): min=8432, max=38152, avg=9051.44, stdev=1105.59 00:14:04.283 clat (usec): min=46, max=120, avg=62.03, stdev= 3.78 00:14:04.283 lat (usec): min=61, max=158, avg=71.08, stdev= 3.96 00:14:04.283 clat percentiles (usec): 00:14:04.283 | 1.00th=[ 56], 5.00th=[ 57], 10.00th=[ 58], 20.00th=[ 59], 00:14:04.283 | 30.00th=[ 60], 40.00th=[ 61], 50.00th=[ 62], 60.00th=[ 63], 00:14:04.283 | 70.00th=[ 64], 80.00th=[ 66], 90.00th=[ 68], 95.00th=[ 69], 00:14:04.283 | 99.00th=[ 73], 99.50th=[ 74], 99.90th=[ 82], 99.95th=[ 84], 00:14:04.283 | 99.99th=[ 121] 00:14:04.283 write: IOPS=7059, BW=27.6MiB/s (28.9MB/s)(27.6MiB/1001msec); 0 zone resets 00:14:04.283 slat (nsec): min=10549, max=43311, avg=11295.95, stdev=1138.48 00:14:04.283 clat (usec): min=38, max=246, avg=59.37, stdev= 4.33 00:14:04.283 lat (usec): min=60, max=257, avg=70.66, stdev= 4.49 00:14:04.283 clat percentiles (usec): 00:14:04.283 | 1.00th=[ 53], 5.00th=[ 55], 10.00th=[ 56], 20.00th=[ 57], 00:14:04.283 | 30.00th=[ 58], 40.00th=[ 59], 50.00th=[ 60], 60.00th=[ 61], 00:14:04.283 | 70.00th=[ 62], 80.00th=[ 63], 90.00th=[ 65], 95.00th=[ 67], 00:14:04.283 | 99.00th=[ 70], 99.50th=[ 72], 99.90th=[ 82], 99.95th=[ 86], 00:14:04.283 | 99.99th=[ 247] 00:14:04.283 bw ( KiB/s): min=28672, max=28672, per=100.00%, avg=28672.00, stdev= 0.00, samples=1 00:14:04.283 iops : min= 7168, max= 7168, avg=7168.00, stdev= 0.00, samples=1 00:14:04.283 lat (usec) : 50=0.04%, 100=99.93%, 250=0.03% 00:14:04.283 cpu : usr=8.70%, sys=13.60%, ctx=13723, majf=0, minf=1 00:14:04.283 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:04.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.283 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:04.283 issued rwts: total=6656,7067,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:04.283 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:04.283 00:14:04.283 Run status group 0 (all jobs): 00:14:04.283 READ: bw=26.0MiB/s (27.2MB/s), 26.0MiB/s-26.0MiB/s (27.2MB/s-27.2MB/s), io=26.0MiB (27.3MB), run=1001-1001msec 00:14:04.283 WRITE: bw=27.6MiB/s (28.9MB/s), 27.6MiB/s-27.6MiB/s (28.9MB/s-28.9MB/s), io=27.6MiB (28.9MB), run=1001-1001msec 00:14:04.283 00:14:04.283 Disk stats (read/write): 00:14:04.283 nvme0n1: ios=6194/6200, merge=0/0, ticks=348/330, in_queue=678, util=90.88% 00:14:04.283 18:02:13 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:06.184 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:14:06.184 18:02:15 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:06.184 18:02:15 -- common/autotest_common.sh@1215 -- # local i=0 00:14:06.184 18:02:15 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:14:06.184 18:02:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:06.184 18:02:15 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:14:06.184 18:02:15 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:06.184 18:02:15 -- common/autotest_common.sh@1227 -- # return 0 00:14:06.184 18:02:15 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:14:06.184 18:02:15 -- target/nmic.sh@53 -- # nvmftestfini 00:14:06.184 18:02:15 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:06.184 18:02:15 -- nvmf/common.sh@117 -- # sync 00:14:06.184 18:02:15 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:06.184 18:02:15 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:06.184 18:02:15 -- nvmf/common.sh@120 -- # set +e 00:14:06.184 18:02:15 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:06.184 18:02:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:06.184 rmmod nvme_rdma 00:14:06.184 rmmod nvme_fabrics 00:14:06.444 18:02:15 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:06.444 18:02:15 -- nvmf/common.sh@124 -- # set -e 00:14:06.444 18:02:15 -- nvmf/common.sh@125 -- # return 0 00:14:06.444 18:02:15 -- nvmf/common.sh@478 -- # '[' -n 950237 ']' 00:14:06.444 18:02:15 -- nvmf/common.sh@479 -- # killprocess 950237 00:14:06.444 18:02:15 -- common/autotest_common.sh@946 -- # '[' -z 950237 ']' 00:14:06.444 18:02:15 -- common/autotest_common.sh@950 -- # kill -0 950237 00:14:06.444 18:02:15 -- common/autotest_common.sh@951 -- # uname 00:14:06.444 18:02:15 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:06.444 18:02:15 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 950237 00:14:06.444 18:02:15 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:14:06.444 18:02:15 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:14:06.444 18:02:15 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 950237' 00:14:06.444 killing process with pid 950237 00:14:06.444 18:02:15 -- common/autotest_common.sh@965 -- # kill 950237 00:14:06.444 18:02:15 -- common/autotest_common.sh@970 -- # wait 950237 00:14:06.444 [2024-04-26 18:02:15.540554] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:06.703 18:02:15 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:06.703 18:02:15 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:06.703 00:14:06.703 real 0m15.664s 00:14:06.703 user 0m39.024s 00:14:06.703 sys 0m5.953s 00:14:06.703 18:02:15 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:06.703 18:02:15 -- common/autotest_common.sh@10 -- # set +x 00:14:06.703 ************************************ 00:14:06.703 END TEST nvmf_nmic 00:14:06.703 ************************************ 00:14:06.703 18:02:15 -- nvmf/nvmf.sh@55 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:14:06.703 18:02:15 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:06.703 18:02:15 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:06.703 18:02:15 -- common/autotest_common.sh@10 -- # set +x 00:14:06.962 ************************************ 00:14:06.962 START TEST nvmf_fio_target 00:14:06.962 ************************************ 00:14:06.962 18:02:15 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=rdma 00:14:06.962 * Looking for test storage... 00:14:06.962 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:06.962 18:02:16 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:06.962 18:02:16 -- nvmf/common.sh@7 -- # uname -s 00:14:06.962 18:02:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:06.962 18:02:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:06.962 18:02:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:06.962 18:02:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:06.962 18:02:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:06.962 18:02:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:06.962 18:02:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:06.962 18:02:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:06.962 18:02:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:06.962 18:02:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:06.962 18:02:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:14:06.962 18:02:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:14:06.962 18:02:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:06.962 18:02:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:06.962 18:02:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:06.962 18:02:16 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:06.962 18:02:16 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:06.962 18:02:16 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:06.962 18:02:16 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:06.962 18:02:16 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:06.962 18:02:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.962 18:02:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.962 18:02:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.962 18:02:16 -- paths/export.sh@5 -- # export PATH 00:14:06.962 18:02:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:06.962 18:02:16 -- nvmf/common.sh@47 -- # : 0 00:14:06.962 18:02:16 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:06.962 18:02:16 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:06.962 18:02:16 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:06.962 18:02:16 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:06.962 18:02:16 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:06.962 18:02:16 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:06.962 18:02:16 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:06.962 18:02:16 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:06.963 18:02:16 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:06.963 18:02:16 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:06.963 18:02:16 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:14:06.963 18:02:16 -- target/fio.sh@16 -- # nvmftestinit 00:14:06.963 18:02:16 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:06.963 18:02:16 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:06.963 18:02:16 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:06.963 18:02:16 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:06.963 18:02:16 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:06.963 18:02:16 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:06.963 18:02:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:06.963 18:02:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:06.963 18:02:16 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:06.963 18:02:16 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:06.963 18:02:16 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:06.963 18:02:16 -- common/autotest_common.sh@10 -- # set +x 00:14:13.546 18:02:21 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:13.546 18:02:21 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:13.546 18:02:21 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:13.546 18:02:21 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:13.546 18:02:21 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:13.546 18:02:21 -- nvmf/common.sh@295 -- # net_devs=() 00:14:13.546 18:02:21 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@296 -- # e810=() 00:14:13.546 18:02:21 -- nvmf/common.sh@296 -- # local -ga e810 00:14:13.546 18:02:21 -- nvmf/common.sh@297 -- # x722=() 00:14:13.546 18:02:21 -- nvmf/common.sh@297 -- # local -ga x722 00:14:13.546 18:02:21 -- nvmf/common.sh@298 -- # mlx=() 00:14:13.546 18:02:21 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:13.546 18:02:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:13.546 18:02:21 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:13.546 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:13.546 18:02:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:13.546 18:02:21 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:13.546 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:13.546 18:02:21 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:13.546 18:02:21 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.546 18:02:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.546 18:02:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:13.546 Found net devices under 0000:18:00.0: mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:13.546 18:02:21 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:13.546 18:02:21 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:13.546 Found net devices under 0000:18:00.1: mlx_0_1 00:14:13.546 18:02:21 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:13.546 18:02:21 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:13.546 18:02:21 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:13.546 18:02:21 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:13.546 18:02:21 -- nvmf/common.sh@58 -- # uname 00:14:13.546 18:02:21 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:13.546 18:02:21 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:13.546 18:02:21 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:13.546 18:02:21 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:13.546 18:02:21 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:13.546 18:02:21 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:13.546 18:02:21 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:13.546 18:02:21 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:13.546 18:02:21 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:13.546 18:02:21 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:13.546 18:02:21 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:13.546 18:02:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:13.546 18:02:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:13.546 18:02:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@105 -- # continue 2 00:14:13.546 18:02:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:13.546 18:02:21 -- nvmf/common.sh@105 -- # continue 2 00:14:13.546 18:02:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:13.546 18:02:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:13.546 18:02:21 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:13.546 18:02:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:13.546 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:13.546 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:13.546 altname enp24s0f0np0 00:14:13.546 altname ens785f0np0 00:14:13.546 inet 192.168.100.8/24 scope global mlx_0_0 00:14:13.546 valid_lft forever preferred_lft forever 00:14:13.546 18:02:21 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:13.546 18:02:21 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:13.546 18:02:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:13.546 18:02:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:13.546 18:02:21 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:13.546 18:02:21 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:13.546 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:13.546 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:13.546 altname enp24s0f1np1 00:14:13.546 altname ens785f1np1 00:14:13.546 inet 192.168.100.9/24 scope global mlx_0_1 00:14:13.546 valid_lft forever preferred_lft forever 00:14:13.546 18:02:21 -- nvmf/common.sh@411 -- # return 0 00:14:13.546 18:02:21 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:13.546 18:02:21 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:13.546 18:02:21 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:13.546 18:02:21 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:13.546 18:02:21 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:13.546 18:02:21 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:13.546 18:02:21 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:13.546 18:02:21 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:13.546 18:02:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.546 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:13.546 18:02:21 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:13.546 18:02:21 -- nvmf/common.sh@105 -- # continue 2 00:14:13.546 18:02:21 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:13.547 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.547 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:13.547 18:02:21 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:13.547 18:02:21 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:13.547 18:02:21 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:13.547 18:02:21 -- nvmf/common.sh@105 -- # continue 2 00:14:13.547 18:02:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:13.547 18:02:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:13.547 18:02:21 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:13.547 18:02:21 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:13.547 18:02:21 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:13.547 18:02:21 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:13.547 18:02:21 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:13.547 18:02:21 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:13.547 192.168.100.9' 00:14:13.547 18:02:21 -- nvmf/common.sh@446 -- # head -n 1 00:14:13.547 18:02:21 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:13.547 192.168.100.9' 00:14:13.547 18:02:21 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:13.547 18:02:21 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:13.547 192.168.100.9' 00:14:13.547 18:02:21 -- nvmf/common.sh@447 -- # tail -n +2 00:14:13.547 18:02:21 -- nvmf/common.sh@447 -- # head -n 1 00:14:13.547 18:02:21 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:13.547 18:02:21 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:13.547 18:02:21 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:13.547 18:02:21 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:13.547 18:02:21 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:13.547 18:02:21 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:13.547 18:02:21 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:14:13.547 18:02:21 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:13.547 18:02:21 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:13.547 18:02:21 -- common/autotest_common.sh@10 -- # set +x 00:14:13.547 18:02:21 -- nvmf/common.sh@470 -- # nvmfpid=954373 00:14:13.547 18:02:21 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:13.547 18:02:21 -- nvmf/common.sh@471 -- # waitforlisten 954373 00:14:13.547 18:02:21 -- common/autotest_common.sh@827 -- # '[' -z 954373 ']' 00:14:13.547 18:02:21 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:13.547 18:02:21 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:13.547 18:02:21 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:13.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:13.547 18:02:21 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:13.547 18:02:21 -- common/autotest_common.sh@10 -- # set +x 00:14:13.547 [2024-04-26 18:02:21.986599] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:14:13.547 [2024-04-26 18:02:21.986657] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:13.547 EAL: No free 2048 kB hugepages reported on node 1 00:14:13.547 [2024-04-26 18:02:22.058384] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:13.547 [2024-04-26 18:02:22.146069] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:13.547 [2024-04-26 18:02:22.146106] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:13.547 [2024-04-26 18:02:22.146116] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:13.547 [2024-04-26 18:02:22.146125] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:13.547 [2024-04-26 18:02:22.146133] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:13.547 [2024-04-26 18:02:22.146175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:13.547 [2024-04-26 18:02:22.146194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:13.547 [2024-04-26 18:02:22.146288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:13.547 [2024-04-26 18:02:22.146290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:13.805 18:02:22 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:13.805 18:02:22 -- common/autotest_common.sh@860 -- # return 0 00:14:13.805 18:02:22 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:13.805 18:02:22 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:13.805 18:02:22 -- common/autotest_common.sh@10 -- # set +x 00:14:13.805 18:02:22 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:13.805 18:02:22 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:14.063 [2024-04-26 18:02:23.031045] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xed14d0/0xed59c0) succeed. 00:14:14.063 [2024-04-26 18:02:23.041508] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xed2b10/0xf17050) succeed. 00:14:14.063 18:02:23 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:14.321 18:02:23 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:14:14.321 18:02:23 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:14.580 18:02:23 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:14:14.580 18:02:23 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:14.580 18:02:23 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:14:14.838 18:02:23 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:14.838 18:02:23 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:14:14.838 18:02:23 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:14:15.097 18:02:24 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.356 18:02:24 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:14:15.356 18:02:24 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.615 18:02:24 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:14:15.615 18:02:24 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:15.615 18:02:24 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:14:15.615 18:02:24 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:14:15.874 18:02:24 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:14:16.133 18:02:25 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:14:16.133 18:02:25 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:16.392 18:02:25 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:14:16.392 18:02:25 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:16.392 18:02:25 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:16.651 [2024-04-26 18:02:25.683562] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:16.651 18:02:25 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:14:16.910 18:02:25 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:14:16.910 18:02:26 -- target/fio.sh@46 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:14:17.848 18:02:27 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:14:17.848 18:02:27 -- common/autotest_common.sh@1194 -- # local i=0 00:14:17.848 18:02:27 -- common/autotest_common.sh@1195 -- # local nvme_device_counter=1 nvme_devices=0 00:14:17.848 18:02:27 -- common/autotest_common.sh@1196 -- # [[ -n 4 ]] 00:14:17.848 18:02:27 -- common/autotest_common.sh@1197 -- # nvme_device_counter=4 00:14:17.848 18:02:27 -- common/autotest_common.sh@1201 -- # sleep 2 00:14:20.460 18:02:29 -- common/autotest_common.sh@1202 -- # (( i++ <= 15 )) 00:14:20.460 18:02:29 -- common/autotest_common.sh@1203 -- # lsblk -l -o NAME,SERIAL 00:14:20.460 18:02:29 -- common/autotest_common.sh@1203 -- # grep -c SPDKISFASTANDAWESOME 00:14:20.460 18:02:29 -- common/autotest_common.sh@1203 -- # nvme_devices=4 00:14:20.460 18:02:29 -- common/autotest_common.sh@1204 -- # (( nvme_devices == nvme_device_counter )) 00:14:20.460 18:02:29 -- common/autotest_common.sh@1204 -- # return 0 00:14:20.460 18:02:29 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:14:20.460 [global] 00:14:20.460 thread=1 00:14:20.460 invalidate=1 00:14:20.460 rw=write 00:14:20.460 time_based=1 00:14:20.460 runtime=1 00:14:20.460 ioengine=libaio 00:14:20.460 direct=1 00:14:20.460 bs=4096 00:14:20.460 iodepth=1 00:14:20.460 norandommap=0 00:14:20.460 numjobs=1 00:14:20.460 00:14:20.460 verify_dump=1 00:14:20.460 verify_backlog=512 00:14:20.460 verify_state_save=0 00:14:20.460 do_verify=1 00:14:20.460 verify=crc32c-intel 00:14:20.460 [job0] 00:14:20.460 filename=/dev/nvme0n1 00:14:20.460 [job1] 00:14:20.460 filename=/dev/nvme0n2 00:14:20.460 [job2] 00:14:20.460 filename=/dev/nvme0n3 00:14:20.460 [job3] 00:14:20.460 filename=/dev/nvme0n4 00:14:20.460 Could not set queue depth (nvme0n1) 00:14:20.460 Could not set queue depth (nvme0n2) 00:14:20.460 Could not set queue depth (nvme0n3) 00:14:20.460 Could not set queue depth (nvme0n4) 00:14:20.460 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:20.460 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:20.460 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:20.460 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:20.460 fio-3.35 00:14:20.460 Starting 4 threads 00:14:21.855 00:14:21.855 job0: (groupid=0, jobs=1): err= 0: pid=955594: Fri Apr 26 18:02:30 2024 00:14:21.855 read: IOPS=3784, BW=14.8MiB/s (15.5MB/s)(14.8MiB/1001msec) 00:14:21.855 slat (nsec): min=8541, max=33131, avg=9347.06, stdev=1233.97 00:14:21.855 clat (usec): min=70, max=371, avg=116.34, stdev=15.26 00:14:21.855 lat (usec): min=79, max=380, avg=125.68, stdev=15.35 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 82], 5.00th=[ 91], 10.00th=[ 100], 20.00th=[ 106], 00:14:21.855 | 30.00th=[ 111], 40.00th=[ 114], 50.00th=[ 117], 60.00th=[ 120], 00:14:21.855 | 70.00th=[ 123], 80.00th=[ 127], 90.00th=[ 135], 95.00th=[ 139], 00:14:21.855 | 99.00th=[ 157], 99.50th=[ 172], 99.90th=[ 196], 99.95th=[ 227], 00:14:21.855 | 99.99th=[ 371] 00:14:21.855 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:14:21.855 slat (nsec): min=10606, max=50683, avg=11630.06, stdev=1493.76 00:14:21.855 clat (usec): min=65, max=354, avg=112.32, stdev=15.29 00:14:21.855 lat (usec): min=77, max=365, avg=123.95, stdev=15.49 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 77], 5.00th=[ 91], 10.00th=[ 97], 20.00th=[ 101], 00:14:21.855 | 30.00th=[ 105], 40.00th=[ 109], 50.00th=[ 112], 60.00th=[ 115], 00:14:21.855 | 70.00th=[ 119], 80.00th=[ 124], 90.00th=[ 130], 95.00th=[ 137], 00:14:21.855 | 99.00th=[ 155], 99.50th=[ 167], 99.90th=[ 188], 99.95th=[ 198], 00:14:21.855 | 99.99th=[ 355] 00:14:21.855 bw ( KiB/s): min=16384, max=16384, per=24.87%, avg=16384.00, stdev= 0.00, samples=1 00:14:21.855 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:14:21.855 lat (usec) : 100=13.52%, 250=86.45%, 500=0.03% 00:14:21.855 cpu : usr=4.70%, sys=8.60%, ctx=7884, majf=0, minf=1 00:14:21.855 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 issued rwts: total=3788,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.855 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.855 job1: (groupid=0, jobs=1): err= 0: pid=955612: Fri Apr 26 18:02:30 2024 00:14:21.855 read: IOPS=3620, BW=14.1MiB/s (14.8MB/s)(14.2MiB/1001msec) 00:14:21.855 slat (nsec): min=8678, max=44416, avg=9470.51, stdev=1283.56 00:14:21.855 clat (usec): min=74, max=326, avg=120.42, stdev=18.88 00:14:21.855 lat (usec): min=83, max=335, avg=129.89, stdev=19.13 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 86], 5.00th=[ 98], 10.00th=[ 103], 20.00th=[ 108], 00:14:21.855 | 30.00th=[ 112], 40.00th=[ 115], 50.00th=[ 118], 60.00th=[ 121], 00:14:21.855 | 70.00th=[ 126], 80.00th=[ 131], 90.00th=[ 141], 95.00th=[ 153], 00:14:21.855 | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 249], 99.95th=[ 314], 00:14:21.855 | 99.99th=[ 326] 00:14:21.855 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:14:21.855 slat (nsec): min=10838, max=45589, avg=11730.43, stdev=1193.91 00:14:21.855 clat (usec): min=63, max=345, avg=113.67, stdev=15.92 00:14:21.855 lat (usec): min=75, max=357, avg=125.40, stdev=15.98 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 87], 5.00th=[ 95], 10.00th=[ 99], 20.00th=[ 103], 00:14:21.855 | 30.00th=[ 106], 40.00th=[ 110], 50.00th=[ 113], 60.00th=[ 115], 00:14:21.855 | 70.00th=[ 119], 80.00th=[ 123], 90.00th=[ 131], 95.00th=[ 139], 00:14:21.855 | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 255], 99.95th=[ 314], 00:14:21.855 | 99.99th=[ 347] 00:14:21.855 bw ( KiB/s): min=16384, max=16384, per=24.87%, avg=16384.00, stdev= 0.00, samples=1 00:14:21.855 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:14:21.855 lat (usec) : 100=9.75%, 250=90.14%, 500=0.10% 00:14:21.855 cpu : usr=5.20%, sys=7.90%, ctx=7720, majf=0, minf=1 00:14:21.855 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 issued rwts: total=3624,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.855 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.855 job2: (groupid=0, jobs=1): err= 0: pid=955633: Fri Apr 26 18:02:30 2024 00:14:21.855 read: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec) 00:14:21.855 slat (nsec): min=8617, max=36093, avg=9636.22, stdev=1164.42 00:14:21.855 clat (usec): min=80, max=381, avg=110.67, stdev=22.20 00:14:21.855 lat (usec): min=90, max=391, avg=120.30, stdev=22.25 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 87], 5.00th=[ 91], 10.00th=[ 93], 20.00th=[ 95], 00:14:21.855 | 30.00th=[ 98], 40.00th=[ 100], 50.00th=[ 102], 60.00th=[ 105], 00:14:21.855 | 70.00th=[ 111], 80.00th=[ 130], 90.00th=[ 145], 95.00th=[ 157], 00:14:21.855 | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 210], 99.95th=[ 262], 00:14:21.855 | 99.99th=[ 383] 00:14:21.855 write: IOPS=4193, BW=16.4MiB/s (17.2MB/s)(16.4MiB/1001msec); 0 zone resets 00:14:21.855 slat (nsec): min=11066, max=41375, avg=12162.77, stdev=1530.22 00:14:21.855 clat (usec): min=75, max=209, avg=104.37, stdev=17.94 00:14:21.855 lat (usec): min=87, max=220, avg=116.53, stdev=17.98 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 83], 5.00th=[ 86], 10.00th=[ 89], 20.00th=[ 91], 00:14:21.855 | 30.00th=[ 93], 40.00th=[ 95], 50.00th=[ 98], 60.00th=[ 100], 00:14:21.855 | 70.00th=[ 106], 80.00th=[ 122], 90.00th=[ 135], 95.00th=[ 141], 00:14:21.855 | 99.00th=[ 153], 99.50th=[ 161], 99.90th=[ 182], 99.95th=[ 188], 00:14:21.855 | 99.99th=[ 210] 00:14:21.855 bw ( KiB/s): min=16384, max=16384, per=24.87%, avg=16384.00, stdev= 0.00, samples=1 00:14:21.855 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:14:21.855 lat (usec) : 100=50.96%, 250=49.00%, 500=0.04% 00:14:21.855 cpu : usr=6.60%, sys=7.90%, ctx=8294, majf=0, minf=1 00:14:21.855 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 issued rwts: total=4096,4198,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.855 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.855 job3: (groupid=0, jobs=1): err= 0: pid=955640: Fri Apr 26 18:02:30 2024 00:14:21.855 read: IOPS=3970, BW=15.5MiB/s (16.3MB/s)(15.5MiB/1000msec) 00:14:21.855 slat (nsec): min=8786, max=33155, avg=9683.73, stdev=1366.81 00:14:21.855 clat (usec): min=78, max=233, avg=114.14, stdev=21.60 00:14:21.855 lat (usec): min=87, max=242, avg=123.83, stdev=21.77 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 87], 5.00th=[ 91], 10.00th=[ 95], 20.00th=[ 98], 00:14:21.855 | 30.00th=[ 101], 40.00th=[ 103], 50.00th=[ 106], 60.00th=[ 110], 00:14:21.855 | 70.00th=[ 117], 80.00th=[ 137], 90.00th=[ 147], 95.00th=[ 155], 00:14:21.855 | 99.00th=[ 180], 99.50th=[ 188], 99.90th=[ 208], 99.95th=[ 229], 00:14:21.855 | 99.99th=[ 233] 00:14:21.855 write: IOPS=4096, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1000msec); 0 zone resets 00:14:21.855 slat (nsec): min=9634, max=40680, avg=12097.14, stdev=1514.16 00:14:21.855 clat (usec): min=75, max=247, avg=107.77, stdev=18.83 00:14:21.855 lat (usec): min=86, max=259, avg=119.87, stdev=19.05 00:14:21.855 clat percentiles (usec): 00:14:21.855 | 1.00th=[ 83], 5.00th=[ 87], 10.00th=[ 90], 20.00th=[ 93], 00:14:21.855 | 30.00th=[ 96], 40.00th=[ 98], 50.00th=[ 101], 60.00th=[ 105], 00:14:21.855 | 70.00th=[ 115], 80.00th=[ 129], 90.00th=[ 137], 95.00th=[ 143], 00:14:21.855 | 99.00th=[ 155], 99.50th=[ 165], 99.90th=[ 192], 99.95th=[ 212], 00:14:21.855 | 99.99th=[ 247] 00:14:21.855 bw ( KiB/s): min=16384, max=16384, per=24.87%, avg=16384.00, stdev= 0.00, samples=1 00:14:21.855 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:14:21.855 lat (usec) : 100=36.93%, 250=63.07% 00:14:21.855 cpu : usr=4.10%, sys=10.00%, ctx=8066, majf=0, minf=1 00:14:21.855 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:21.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:21.855 issued rwts: total=3970,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:21.855 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:21.855 00:14:21.855 Run status group 0 (all jobs): 00:14:21.855 READ: bw=60.4MiB/s (63.3MB/s), 14.1MiB/s-16.0MiB/s (14.8MB/s-16.8MB/s), io=60.5MiB (63.4MB), run=1000-1001msec 00:14:21.855 WRITE: bw=64.3MiB/s (67.5MB/s), 16.0MiB/s-16.4MiB/s (16.8MB/s-17.2MB/s), io=64.4MiB (67.5MB), run=1000-1001msec 00:14:21.855 00:14:21.855 Disk stats (read/write): 00:14:21.855 nvme0n1: ios=3122/3373, merge=0/0, ticks=350/361, in_queue=711, util=83.67% 00:14:21.855 nvme0n2: ios=3072/3219, merge=0/0, ticks=364/344, in_queue=708, util=84.65% 00:14:21.855 nvme0n3: ios=3129/3584, merge=0/0, ticks=345/350, in_queue=695, util=88.17% 00:14:21.855 nvme0n4: ios=3072/3474, merge=0/0, ticks=329/382, in_queue=711, util=89.41% 00:14:21.855 18:02:30 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:14:21.855 [global] 00:14:21.855 thread=1 00:14:21.855 invalidate=1 00:14:21.856 rw=randwrite 00:14:21.856 time_based=1 00:14:21.856 runtime=1 00:14:21.856 ioengine=libaio 00:14:21.856 direct=1 00:14:21.856 bs=4096 00:14:21.856 iodepth=1 00:14:21.856 norandommap=0 00:14:21.856 numjobs=1 00:14:21.856 00:14:21.856 verify_dump=1 00:14:21.856 verify_backlog=512 00:14:21.856 verify_state_save=0 00:14:21.856 do_verify=1 00:14:21.856 verify=crc32c-intel 00:14:21.856 [job0] 00:14:21.856 filename=/dev/nvme0n1 00:14:21.856 [job1] 00:14:21.856 filename=/dev/nvme0n2 00:14:21.856 [job2] 00:14:21.856 filename=/dev/nvme0n3 00:14:21.856 [job3] 00:14:21.856 filename=/dev/nvme0n4 00:14:21.856 Could not set queue depth (nvme0n1) 00:14:21.856 Could not set queue depth (nvme0n2) 00:14:21.856 Could not set queue depth (nvme0n3) 00:14:21.856 Could not set queue depth (nvme0n4) 00:14:21.856 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:21.856 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:21.856 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:21.856 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:21.856 fio-3.35 00:14:21.856 Starting 4 threads 00:14:23.232 00:14:23.232 job0: (groupid=0, jobs=1): err= 0: pid=955941: Fri Apr 26 18:02:32 2024 00:14:23.232 read: IOPS=5038, BW=19.7MiB/s (20.6MB/s)(19.7MiB/1001msec) 00:14:23.232 slat (nsec): min=8677, max=31329, avg=9307.26, stdev=935.74 00:14:23.232 clat (usec): min=56, max=314, avg=86.70, stdev= 7.89 00:14:23.232 lat (usec): min=65, max=323, avg=96.01, stdev= 8.00 00:14:23.232 clat percentiles (usec): 00:14:23.232 | 1.00th=[ 73], 5.00th=[ 77], 10.00th=[ 79], 20.00th=[ 81], 00:14:23.232 | 30.00th=[ 83], 40.00th=[ 85], 50.00th=[ 87], 60.00th=[ 88], 00:14:23.232 | 70.00th=[ 90], 80.00th=[ 92], 90.00th=[ 96], 95.00th=[ 99], 00:14:23.232 | 99.00th=[ 108], 99.50th=[ 111], 99.90th=[ 118], 99.95th=[ 131], 00:14:23.232 | 99.99th=[ 314] 00:14:23.232 write: IOPS=5114, BW=20.0MiB/s (20.9MB/s)(20.0MiB/1001msec); 0 zone resets 00:14:23.232 slat (nsec): min=10594, max=64430, avg=11276.05, stdev=1416.31 00:14:23.232 clat (usec): min=52, max=238, avg=85.49, stdev=12.40 00:14:23.232 lat (usec): min=63, max=257, avg=96.76, stdev=12.60 00:14:23.232 clat percentiles (usec): 00:14:23.232 | 1.00th=[ 71], 5.00th=[ 74], 10.00th=[ 76], 20.00th=[ 79], 00:14:23.232 | 30.00th=[ 80], 40.00th=[ 82], 50.00th=[ 84], 60.00th=[ 85], 00:14:23.232 | 70.00th=[ 87], 80.00th=[ 90], 90.00th=[ 95], 95.00th=[ 109], 00:14:23.232 | 99.00th=[ 137], 99.50th=[ 145], 99.90th=[ 167], 99.95th=[ 174], 00:14:23.232 | 99.99th=[ 239] 00:14:23.232 bw ( KiB/s): min=20480, max=20480, per=34.55%, avg=20480.00, stdev= 0.00, samples=1 00:14:23.232 iops : min= 5120, max= 5120, avg=5120.00, stdev= 0.00, samples=1 00:14:23.232 lat (usec) : 100=94.82%, 250=5.18%, 500=0.01% 00:14:23.232 cpu : usr=5.80%, sys=11.00%, ctx=10164, majf=0, minf=1 00:14:23.232 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:23.232 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.232 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.232 issued rwts: total=5044,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:23.232 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:23.232 job1: (groupid=0, jobs=1): err= 0: pid=955942: Fri Apr 26 18:02:32 2024 00:14:23.233 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:14:23.233 slat (nsec): min=8716, max=30241, avg=10298.80, stdev=1543.71 00:14:23.233 clat (usec): min=68, max=367, avg=149.53, stdev=23.65 00:14:23.233 lat (usec): min=78, max=378, avg=159.83, stdev=23.76 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 79], 5.00th=[ 100], 10.00th=[ 133], 20.00th=[ 139], 00:14:23.233 | 30.00th=[ 145], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 153], 00:14:23.233 | 70.00th=[ 157], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 182], 00:14:23.233 | 99.00th=[ 215], 99.50th=[ 255], 99.90th=[ 330], 99.95th=[ 355], 00:14:23.233 | 99.99th=[ 367] 00:14:23.233 write: IOPS=3239, BW=12.7MiB/s (13.3MB/s)(12.7MiB/1001msec); 0 zone resets 00:14:23.233 slat (nsec): min=10645, max=38780, avg=12349.70, stdev=1721.18 00:14:23.233 clat (usec): min=61, max=353, avg=140.34, stdev=23.85 00:14:23.233 lat (usec): min=78, max=365, avg=152.69, stdev=23.97 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 75], 5.00th=[ 92], 10.00th=[ 121], 20.00th=[ 129], 00:14:23.233 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 141], 60.00th=[ 143], 00:14:23.233 | 70.00th=[ 147], 80.00th=[ 153], 90.00th=[ 165], 95.00th=[ 174], 00:14:23.233 | 99.00th=[ 206], 99.50th=[ 249], 99.90th=[ 314], 99.95th=[ 355], 00:14:23.233 | 99.99th=[ 355] 00:14:23.233 bw ( KiB/s): min=13280, max=13280, per=22.41%, avg=13280.00, stdev= 0.00, samples=1 00:14:23.233 iops : min= 3320, max= 3320, avg=3320.00, stdev= 0.00, samples=1 00:14:23.233 lat (usec) : 100=5.11%, 250=94.39%, 500=0.49% 00:14:23.233 cpu : usr=3.80%, sys=7.70%, ctx=6315, majf=0, minf=1 00:14:23.233 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:23.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 issued rwts: total=3072,3243,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:23.233 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:23.233 job2: (groupid=0, jobs=1): err= 0: pid=955943: Fri Apr 26 18:02:32 2024 00:14:23.233 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:14:23.233 slat (nsec): min=9004, max=31165, avg=10430.12, stdev=1382.01 00:14:23.233 clat (usec): min=75, max=370, avg=150.95, stdev=22.66 00:14:23.233 lat (usec): min=85, max=380, avg=161.38, stdev=22.77 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 83], 5.00th=[ 125], 10.00th=[ 135], 20.00th=[ 141], 00:14:23.233 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 151], 60.00th=[ 153], 00:14:23.233 | 70.00th=[ 157], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 182], 00:14:23.233 | 99.00th=[ 219], 99.50th=[ 255], 99.90th=[ 334], 99.95th=[ 355], 00:14:23.233 | 99.99th=[ 371] 00:14:23.233 write: IOPS=3207, BW=12.5MiB/s (13.1MB/s)(12.5MiB/1001msec); 0 zone resets 00:14:23.233 slat (nsec): min=10814, max=40850, avg=12529.96, stdev=1668.62 00:14:23.233 clat (usec): min=68, max=348, avg=140.26, stdev=22.93 00:14:23.233 lat (usec): min=83, max=361, avg=152.79, stdev=23.01 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 82], 5.00th=[ 106], 10.00th=[ 118], 20.00th=[ 127], 00:14:23.233 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 141], 60.00th=[ 143], 00:14:23.233 | 70.00th=[ 147], 80.00th=[ 153], 90.00th=[ 163], 95.00th=[ 178], 00:14:23.233 | 99.00th=[ 208], 99.50th=[ 233], 99.90th=[ 314], 99.95th=[ 347], 00:14:23.233 | 99.99th=[ 351] 00:14:23.233 bw ( KiB/s): min=13288, max=13288, per=22.42%, avg=13288.00, stdev= 0.00, samples=1 00:14:23.233 iops : min= 3322, max= 3322, avg=3322.00, stdev= 0.00, samples=1 00:14:23.233 lat (usec) : 100=4.25%, 250=95.35%, 500=0.40% 00:14:23.233 cpu : usr=3.50%, sys=8.00%, ctx=6283, majf=0, minf=1 00:14:23.233 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:23.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 issued rwts: total=3072,3211,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:23.233 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:23.233 job3: (groupid=0, jobs=1): err= 0: pid=955944: Fri Apr 26 18:02:32 2024 00:14:23.233 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:14:23.233 slat (nsec): min=9053, max=23833, avg=10295.52, stdev=1024.01 00:14:23.233 clat (usec): min=75, max=405, avg=150.38, stdev=23.18 00:14:23.233 lat (usec): min=87, max=415, avg=160.68, stdev=23.28 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 84], 5.00th=[ 123], 10.00th=[ 133], 20.00th=[ 141], 00:14:23.233 | 30.00th=[ 145], 40.00th=[ 147], 50.00th=[ 151], 60.00th=[ 153], 00:14:23.233 | 70.00th=[ 155], 80.00th=[ 161], 90.00th=[ 172], 95.00th=[ 182], 00:14:23.233 | 99.00th=[ 225], 99.50th=[ 265], 99.90th=[ 330], 99.95th=[ 383], 00:14:23.233 | 99.99th=[ 404] 00:14:23.233 write: IOPS=3254, BW=12.7MiB/s (13.3MB/s)(12.7MiB/1001msec); 0 zone resets 00:14:23.233 slat (nsec): min=10938, max=63438, avg=12064.95, stdev=1552.55 00:14:23.233 clat (usec): min=71, max=359, avg=139.34, stdev=23.60 00:14:23.233 lat (usec): min=83, max=371, avg=151.41, stdev=23.75 00:14:23.233 clat percentiles (usec): 00:14:23.233 | 1.00th=[ 79], 5.00th=[ 99], 10.00th=[ 116], 20.00th=[ 127], 00:14:23.233 | 30.00th=[ 133], 40.00th=[ 137], 50.00th=[ 139], 60.00th=[ 143], 00:14:23.233 | 70.00th=[ 147], 80.00th=[ 153], 90.00th=[ 163], 95.00th=[ 176], 00:14:23.233 | 99.00th=[ 206], 99.50th=[ 241], 99.90th=[ 314], 99.95th=[ 347], 00:14:23.233 | 99.99th=[ 359] 00:14:23.233 bw ( KiB/s): min=13576, max=13576, per=22.91%, avg=13576.00, stdev= 0.00, samples=1 00:14:23.233 iops : min= 3394, max= 3394, avg=3394.00, stdev= 0.00, samples=1 00:14:23.233 lat (usec) : 100=4.71%, 250=94.74%, 500=0.55% 00:14:23.233 cpu : usr=4.40%, sys=6.80%, ctx=6330, majf=0, minf=1 00:14:23.233 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:23.233 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:23.233 issued rwts: total=3072,3258,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:23.233 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:23.233 00:14:23.233 Run status group 0 (all jobs): 00:14:23.233 READ: bw=55.6MiB/s (58.3MB/s), 12.0MiB/s-19.7MiB/s (12.6MB/s-20.6MB/s), io=55.7MiB (58.4MB), run=1001-1001msec 00:14:23.233 WRITE: bw=57.9MiB/s (60.7MB/s), 12.5MiB/s-20.0MiB/s (13.1MB/s-20.9MB/s), io=57.9MiB (60.8MB), run=1001-1001msec 00:14:23.233 00:14:23.233 Disk stats (read/write): 00:14:23.233 nvme0n1: ios=4146/4264, merge=0/0, ticks=349/335, in_queue=684, util=83.87% 00:14:23.233 nvme0n2: ios=2560/2686, merge=0/0, ticks=368/349, in_queue=717, util=84.68% 00:14:23.233 nvme0n3: ios=2560/2662, merge=0/0, ticks=374/345, in_queue=719, util=88.19% 00:14:23.233 nvme0n4: ios=2560/2712, merge=0/0, ticks=374/348, in_queue=722, util=89.33% 00:14:23.233 18:02:32 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:14:23.233 [global] 00:14:23.233 thread=1 00:14:23.233 invalidate=1 00:14:23.233 rw=write 00:14:23.233 time_based=1 00:14:23.233 runtime=1 00:14:23.233 ioengine=libaio 00:14:23.233 direct=1 00:14:23.233 bs=4096 00:14:23.233 iodepth=128 00:14:23.233 norandommap=0 00:14:23.233 numjobs=1 00:14:23.233 00:14:23.233 verify_dump=1 00:14:23.233 verify_backlog=512 00:14:23.233 verify_state_save=0 00:14:23.233 do_verify=1 00:14:23.233 verify=crc32c-intel 00:14:23.233 [job0] 00:14:23.233 filename=/dev/nvme0n1 00:14:23.233 [job1] 00:14:23.233 filename=/dev/nvme0n2 00:14:23.233 [job2] 00:14:23.233 filename=/dev/nvme0n3 00:14:23.233 [job3] 00:14:23.233 filename=/dev/nvme0n4 00:14:23.233 Could not set queue depth (nvme0n1) 00:14:23.233 Could not set queue depth (nvme0n2) 00:14:23.233 Could not set queue depth (nvme0n3) 00:14:23.233 Could not set queue depth (nvme0n4) 00:14:23.492 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:23.492 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:23.492 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:23.492 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:23.492 fio-3.35 00:14:23.492 Starting 4 threads 00:14:24.868 00:14:24.868 job0: (groupid=0, jobs=1): err= 0: pid=956240: Fri Apr 26 18:02:33 2024 00:14:24.868 read: IOPS=5099, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1004msec) 00:14:24.868 slat (usec): min=2, max=7538, avg=87.87, stdev=398.23 00:14:24.868 clat (usec): min=2677, max=22555, avg=11782.14, stdev=4830.32 00:14:24.868 lat (usec): min=2686, max=25482, avg=11870.01, stdev=4862.13 00:14:24.868 clat percentiles (usec): 00:14:24.868 | 1.00th=[ 4047], 5.00th=[ 5014], 10.00th=[ 5604], 20.00th=[ 6849], 00:14:24.868 | 30.00th=[ 8586], 40.00th=[10290], 50.00th=[11076], 60.00th=[12649], 00:14:24.868 | 70.00th=[14746], 80.00th=[16909], 90.00th=[18744], 95.00th=[20055], 00:14:24.868 | 99.00th=[21103], 99.50th=[21627], 99.90th=[22414], 99.95th=[22414], 00:14:24.868 | 99.99th=[22676] 00:14:24.868 write: IOPS=5426, BW=21.2MiB/s (22.2MB/s)(21.3MiB/1004msec); 0 zone resets 00:14:24.868 slat (usec): min=2, max=5189, avg=93.56, stdev=403.94 00:14:24.868 clat (usec): min=1459, max=22776, avg=12225.23, stdev=5230.87 00:14:24.868 lat (usec): min=1468, max=22786, avg=12318.79, stdev=5261.90 00:14:24.868 clat percentiles (usec): 00:14:24.868 | 1.00th=[ 2999], 5.00th=[ 4424], 10.00th=[ 5669], 20.00th=[ 6849], 00:14:24.868 | 30.00th=[ 8586], 40.00th=[10028], 50.00th=[11731], 60.00th=[14091], 00:14:24.868 | 70.00th=[15926], 80.00th=[17957], 90.00th=[19530], 95.00th=[20317], 00:14:24.868 | 99.00th=[21627], 99.50th=[21890], 99.90th=[22676], 99.95th=[22676], 00:14:24.868 | 99.99th=[22676] 00:14:24.868 bw ( KiB/s): min=20784, max=21776, per=21.45%, avg=21280.00, stdev=701.45, samples=2 00:14:24.868 iops : min= 5196, max= 5444, avg=5320.00, stdev=175.36, samples=2 00:14:24.868 lat (msec) : 2=0.13%, 4=1.84%, 10=37.06%, 20=55.22%, 50=5.74% 00:14:24.868 cpu : usr=2.89%, sys=5.18%, ctx=1046, majf=0, minf=1 00:14:24.868 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:14:24.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:24.868 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:24.868 issued rwts: total=5120,5448,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:24.868 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:24.868 job1: (groupid=0, jobs=1): err= 0: pid=956242: Fri Apr 26 18:02:33 2024 00:14:24.868 read: IOPS=6306, BW=24.6MiB/s (25.8MB/s)(24.7MiB/1003msec) 00:14:24.868 slat (usec): min=2, max=7119, avg=78.74, stdev=371.68 00:14:24.868 clat (usec): min=2482, max=24455, avg=10073.68, stdev=5083.17 00:14:24.868 lat (usec): min=4783, max=24880, avg=10152.42, stdev=5124.45 00:14:24.868 clat percentiles (usec): 00:14:24.868 | 1.00th=[ 5145], 5.00th=[ 5407], 10.00th=[ 5538], 20.00th=[ 6128], 00:14:24.868 | 30.00th=[ 6587], 40.00th=[ 6915], 50.00th=[ 7177], 60.00th=[ 8717], 00:14:24.868 | 70.00th=[11863], 80.00th=[15270], 90.00th=[19006], 95.00th=[20317], 00:14:24.868 | 99.00th=[21890], 99.50th=[22152], 99.90th=[24511], 99.95th=[24511], 00:14:24.868 | 99.99th=[24511] 00:14:24.868 write: IOPS=6636, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1003msec); 0 zone resets 00:14:24.868 slat (usec): min=2, max=5518, avg=72.68, stdev=313.11 00:14:24.868 clat (usec): min=3057, max=25164, avg=9509.83, stdev=5011.21 00:14:24.868 lat (usec): min=3067, max=25178, avg=9582.50, stdev=5049.34 00:14:24.868 clat percentiles (usec): 00:14:24.868 | 1.00th=[ 4686], 5.00th=[ 5080], 10.00th=[ 5145], 20.00th=[ 5407], 00:14:24.868 | 30.00th=[ 5932], 40.00th=[ 6259], 50.00th=[ 6718], 60.00th=[ 8586], 00:14:24.868 | 70.00th=[11207], 80.00th=[14353], 90.00th=[18482], 95.00th=[19792], 00:14:24.869 | 99.00th=[20579], 99.50th=[20841], 99.90th=[21890], 99.95th=[22676], 00:14:24.869 | 99.99th=[25035] 00:14:24.869 bw ( KiB/s): min=20824, max=32424, per=26.83%, avg=26624.00, stdev=8202.44, samples=2 00:14:24.869 iops : min= 5206, max= 8106, avg=6656.00, stdev=2050.61, samples=2 00:14:24.869 lat (msec) : 4=0.10%, 10=64.69%, 20=30.62%, 50=4.58% 00:14:24.869 cpu : usr=2.79%, sys=3.99%, ctx=979, majf=0, minf=1 00:14:24.869 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:14:24.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:24.869 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:24.869 issued rwts: total=6325,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:24.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:24.869 job2: (groupid=0, jobs=1): err= 0: pid=956246: Fri Apr 26 18:02:33 2024 00:14:24.869 read: IOPS=6506, BW=25.4MiB/s (26.7MB/s)(25.5MiB/1004msec) 00:14:24.869 slat (usec): min=2, max=4772, avg=74.47, stdev=330.52 00:14:24.869 clat (usec): min=2666, max=24459, avg=9745.04, stdev=4328.10 00:14:24.869 lat (usec): min=3450, max=26123, avg=9819.51, stdev=4355.62 00:14:24.869 clat percentiles (usec): 00:14:24.869 | 1.00th=[ 4621], 5.00th=[ 5145], 10.00th=[ 5604], 20.00th=[ 6194], 00:14:24.869 | 30.00th=[ 6783], 40.00th=[ 7504], 50.00th=[ 8291], 60.00th=[ 9503], 00:14:24.869 | 70.00th=[10945], 80.00th=[13173], 90.00th=[16188], 95.00th=[19006], 00:14:24.869 | 99.00th=[22414], 99.50th=[22938], 99.90th=[23462], 99.95th=[24249], 00:14:24.869 | 99.99th=[24511] 00:14:24.869 write: IOPS=6629, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1004msec); 0 zone resets 00:14:24.869 slat (usec): min=2, max=5283, avg=73.01, stdev=313.33 00:14:24.869 clat (usec): min=3698, max=26824, avg=9504.71, stdev=4178.42 00:14:24.869 lat (usec): min=3772, max=26841, avg=9577.72, stdev=4203.54 00:14:24.869 clat percentiles (usec): 00:14:24.869 | 1.00th=[ 4686], 5.00th=[ 5276], 10.00th=[ 5669], 20.00th=[ 6194], 00:14:24.869 | 30.00th=[ 6652], 40.00th=[ 7242], 50.00th=[ 7963], 60.00th=[ 8717], 00:14:24.869 | 70.00th=[10421], 80.00th=[13042], 90.00th=[16712], 95.00th=[17957], 00:14:24.869 | 99.00th=[19792], 99.50th=[24511], 99.90th=[26084], 99.95th=[26084], 00:14:24.869 | 99.99th=[26870] 00:14:24.869 bw ( KiB/s): min=18416, max=34832, per=26.83%, avg=26624.00, stdev=11607.86, samples=2 00:14:24.869 iops : min= 4604, max= 8708, avg=6656.00, stdev=2901.97, samples=2 00:14:24.869 lat (msec) : 4=0.14%, 10=66.57%, 20=30.71%, 50=2.58% 00:14:24.869 cpu : usr=3.49%, sys=5.58%, ctx=1068, majf=0, minf=1 00:14:24.869 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:14:24.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:24.869 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:24.869 issued rwts: total=6533,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:24.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:24.869 job3: (groupid=0, jobs=1): err= 0: pid=956247: Fri Apr 26 18:02:33 2024 00:14:24.869 read: IOPS=5681, BW=22.2MiB/s (23.3MB/s)(22.3MiB/1004msec) 00:14:24.869 slat (usec): min=2, max=7423, avg=83.09, stdev=419.64 00:14:24.869 clat (usec): min=2390, max=21557, avg=10895.18, stdev=3627.84 00:14:24.869 lat (usec): min=3539, max=21750, avg=10978.26, stdev=3643.06 00:14:24.869 clat percentiles (usec): 00:14:24.869 | 1.00th=[ 4359], 5.00th=[ 5276], 10.00th=[ 6063], 20.00th=[ 7635], 00:14:24.869 | 30.00th=[ 8586], 40.00th=[ 9765], 50.00th=[10552], 60.00th=[11469], 00:14:24.869 | 70.00th=[12518], 80.00th=[14353], 90.00th=[15795], 95.00th=[17171], 00:14:24.869 | 99.00th=[19268], 99.50th=[20579], 99.90th=[21627], 99.95th=[21627], 00:14:24.869 | 99.99th=[21627] 00:14:24.869 write: IOPS=6119, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1004msec); 0 zone resets 00:14:24.869 slat (usec): min=2, max=6363, avg=80.89, stdev=370.79 00:14:24.869 clat (usec): min=1525, max=21845, avg=10562.67, stdev=4073.16 00:14:24.869 lat (usec): min=1565, max=21855, avg=10643.55, stdev=4096.12 00:14:24.869 clat percentiles (usec): 00:14:24.869 | 1.00th=[ 2835], 5.00th=[ 4146], 10.00th=[ 5211], 20.00th=[ 6783], 00:14:24.869 | 30.00th=[ 7832], 40.00th=[ 8848], 50.00th=[10421], 60.00th=[11994], 00:14:24.869 | 70.00th=[13042], 80.00th=[14615], 90.00th=[15926], 95.00th=[17433], 00:14:24.869 | 99.00th=[18744], 99.50th=[19792], 99.90th=[21103], 99.95th=[21103], 00:14:24.869 | 99.99th=[21890] 00:14:24.869 bw ( KiB/s): min=24128, max=24576, per=24.54%, avg=24352.00, stdev=316.78, samples=2 00:14:24.869 iops : min= 6032, max= 6144, avg=6088.00, stdev=79.20, samples=2 00:14:24.869 lat (msec) : 2=0.01%, 4=2.26%, 10=42.35%, 20=54.93%, 50=0.45% 00:14:24.869 cpu : usr=2.99%, sys=5.98%, ctx=1091, majf=0, minf=1 00:14:24.869 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:24.869 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:24.869 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:24.869 issued rwts: total=5704,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:24.869 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:24.869 00:14:24.869 Run status group 0 (all jobs): 00:14:24.869 READ: bw=92.1MiB/s (96.6MB/s), 19.9MiB/s-25.4MiB/s (20.9MB/s-26.7MB/s), io=92.5MiB (97.0MB), run=1003-1004msec 00:14:24.869 WRITE: bw=96.9MiB/s (102MB/s), 21.2MiB/s-25.9MiB/s (22.2MB/s-27.2MB/s), io=97.3MiB (102MB), run=1003-1004msec 00:14:24.869 00:14:24.869 Disk stats (read/write): 00:14:24.869 nvme0n1: ios=4658/4809, merge=0/0, ticks=18218/18145, in_queue=36363, util=85.47% 00:14:24.869 nvme0n2: ios=5015/5120, merge=0/0, ticks=24070/22122, in_queue=46192, util=86.35% 00:14:24.869 nvme0n3: ios=5632/6044, merge=0/0, ticks=15700/16265, in_queue=31965, util=88.38% 00:14:24.869 nvme0n4: ios=5120/5322, merge=0/0, ticks=19501/18603, in_queue=38104, util=88.79% 00:14:24.869 18:02:33 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:14:24.869 [global] 00:14:24.869 thread=1 00:14:24.869 invalidate=1 00:14:24.869 rw=randwrite 00:14:24.869 time_based=1 00:14:24.869 runtime=1 00:14:24.869 ioengine=libaio 00:14:24.869 direct=1 00:14:24.869 bs=4096 00:14:24.869 iodepth=128 00:14:24.869 norandommap=0 00:14:24.869 numjobs=1 00:14:24.869 00:14:24.869 verify_dump=1 00:14:24.869 verify_backlog=512 00:14:24.869 verify_state_save=0 00:14:24.869 do_verify=1 00:14:24.869 verify=crc32c-intel 00:14:24.869 [job0] 00:14:24.869 filename=/dev/nvme0n1 00:14:24.869 [job1] 00:14:24.869 filename=/dev/nvme0n2 00:14:24.869 [job2] 00:14:24.869 filename=/dev/nvme0n3 00:14:24.869 [job3] 00:14:24.869 filename=/dev/nvme0n4 00:14:24.869 Could not set queue depth (nvme0n1) 00:14:24.869 Could not set queue depth (nvme0n2) 00:14:24.869 Could not set queue depth (nvme0n3) 00:14:24.869 Could not set queue depth (nvme0n4) 00:14:25.128 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:25.128 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:25.128 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:25.128 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:14:25.128 fio-3.35 00:14:25.128 Starting 4 threads 00:14:26.505 00:14:26.505 job0: (groupid=0, jobs=1): err= 0: pid=956542: Fri Apr 26 18:02:35 2024 00:14:26.505 read: IOPS=6238, BW=24.4MiB/s (25.6MB/s)(24.5MiB/1005msec) 00:14:26.506 slat (nsec): min=1968, max=5808.1k, avg=75319.46, stdev=388840.93 00:14:26.506 clat (usec): min=1956, max=25117, avg=9933.82, stdev=4442.61 00:14:26.506 lat (usec): min=2975, max=25126, avg=10009.14, stdev=4469.10 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3982], 5.00th=[ 4883], 10.00th=[ 5407], 20.00th=[ 6128], 00:14:26.506 | 30.00th=[ 6915], 40.00th=[ 7504], 50.00th=[ 8717], 60.00th=[10421], 00:14:26.506 | 70.00th=[11731], 80.00th=[13173], 90.00th=[15533], 95.00th=[18482], 00:14:26.506 | 99.00th=[24511], 99.50th=[24773], 99.90th=[25035], 99.95th=[25035], 00:14:26.506 | 99.99th=[25035] 00:14:26.506 write: IOPS=6622, BW=25.9MiB/s (27.1MB/s)(26.0MiB/1005msec); 0 zone resets 00:14:26.506 slat (usec): min=2, max=5757, avg=74.88, stdev=379.01 00:14:26.506 clat (usec): min=1862, max=23646, avg=9716.11, stdev=5053.85 00:14:26.506 lat (usec): min=1941, max=23651, avg=9790.99, stdev=5085.00 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3687], 5.00th=[ 4555], 10.00th=[ 5014], 20.00th=[ 5800], 00:14:26.506 | 30.00th=[ 6390], 40.00th=[ 6915], 50.00th=[ 7439], 60.00th=[ 9110], 00:14:26.506 | 70.00th=[11338], 80.00th=[13566], 90.00th=[17171], 95.00th=[22414], 00:14:26.506 | 99.00th=[23462], 99.50th=[23462], 99.90th=[23725], 99.95th=[23725], 00:14:26.506 | 99.99th=[23725] 00:14:26.506 bw ( KiB/s): min=24576, max=28656, per=27.53%, avg=26616.00, stdev=2885.00, samples=2 00:14:26.506 iops : min= 6144, max= 7164, avg=6654.00, stdev=721.25, samples=2 00:14:26.506 lat (msec) : 2=0.02%, 4=1.28%, 10=58.86%, 20=34.67%, 50=5.18% 00:14:26.506 cpu : usr=4.28%, sys=5.48%, ctx=1346, majf=0, minf=1 00:14:26.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:14:26.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:26.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:26.506 issued rwts: total=6270,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:26.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:26.506 job1: (groupid=0, jobs=1): err= 0: pid=956544: Fri Apr 26 18:02:35 2024 00:14:26.506 read: IOPS=5815, BW=22.7MiB/s (23.8MB/s)(22.8MiB/1004msec) 00:14:26.506 slat (nsec): min=1990, max=7030.4k, avg=80944.70, stdev=402389.27 00:14:26.506 clat (usec): min=3091, max=28228, avg=10590.87, stdev=5905.88 00:14:26.506 lat (usec): min=3156, max=28277, avg=10671.81, stdev=5943.66 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3916], 5.00th=[ 4621], 10.00th=[ 5080], 20.00th=[ 5800], 00:14:26.506 | 30.00th=[ 6456], 40.00th=[ 7242], 50.00th=[ 8717], 60.00th=[10159], 00:14:26.506 | 70.00th=[12518], 80.00th=[15008], 90.00th=[20055], 95.00th=[24773], 00:14:26.506 | 99.00th=[27132], 99.50th=[28181], 99.90th=[28181], 99.95th=[28181], 00:14:26.506 | 99.99th=[28181] 00:14:26.506 write: IOPS=6119, BW=23.9MiB/s (25.1MB/s)(24.0MiB/1004msec); 0 zone resets 00:14:26.506 slat (usec): min=2, max=6345, avg=81.30, stdev=390.13 00:14:26.506 clat (usec): min=3118, max=28671, avg=10632.01, stdev=6006.07 00:14:26.506 lat (usec): min=3127, max=28683, avg=10713.31, stdev=6043.91 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3720], 5.00th=[ 4686], 10.00th=[ 5145], 20.00th=[ 5604], 00:14:26.506 | 30.00th=[ 6259], 40.00th=[ 7046], 50.00th=[ 8356], 60.00th=[ 9634], 00:14:26.506 | 70.00th=[12125], 80.00th=[16057], 90.00th=[20841], 95.00th=[22938], 00:14:26.506 | 99.00th=[27132], 99.50th=[27657], 99.90th=[28705], 99.95th=[28705], 00:14:26.506 | 99.99th=[28705] 00:14:26.506 bw ( KiB/s): min=20480, max=28672, per=25.42%, avg=24576.00, stdev=5792.62, samples=2 00:14:26.506 iops : min= 5120, max= 7168, avg=6144.00, stdev=1448.15, samples=2 00:14:26.506 lat (msec) : 4=1.29%, 10=58.81%, 20=28.57%, 50=11.33% 00:14:26.506 cpu : usr=2.29%, sys=6.68%, ctx=1290, majf=0, minf=1 00:14:26.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.5% 00:14:26.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:26.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:26.506 issued rwts: total=5839,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:26.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:26.506 job2: (groupid=0, jobs=1): err= 0: pid=956548: Fri Apr 26 18:02:35 2024 00:14:26.506 read: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec) 00:14:26.506 slat (usec): min=2, max=7328, avg=102.76, stdev=508.62 00:14:26.506 clat (usec): min=3095, max=24144, avg=13487.13, stdev=3327.97 00:14:26.506 lat (usec): min=3104, max=24147, avg=13589.89, stdev=3343.29 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 4178], 5.00th=[ 8586], 10.00th=[10028], 20.00th=[11076], 00:14:26.506 | 30.00th=[11731], 40.00th=[12256], 50.00th=[13173], 60.00th=[13829], 00:14:26.506 | 70.00th=[14877], 80.00th=[15926], 90.00th=[18220], 95.00th=[19792], 00:14:26.506 | 99.00th=[21627], 99.50th=[23200], 99.90th=[23987], 99.95th=[24249], 00:14:26.506 | 99.99th=[24249] 00:14:26.506 write: IOPS=4819, BW=18.8MiB/s (19.7MB/s)(18.9MiB/1004msec); 0 zone resets 00:14:26.506 slat (usec): min=2, max=8989, avg=104.89, stdev=504.79 00:14:26.506 clat (usec): min=2829, max=32816, avg=13423.22, stdev=4238.95 00:14:26.506 lat (usec): min=3719, max=32824, avg=13528.11, stdev=4260.76 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 6849], 5.00th=[ 8586], 10.00th=[ 9372], 20.00th=[10814], 00:14:26.506 | 30.00th=[11207], 40.00th=[11863], 50.00th=[12518], 60.00th=[13173], 00:14:26.506 | 70.00th=[14222], 80.00th=[15664], 90.00th=[18744], 95.00th=[20317], 00:14:26.506 | 99.00th=[31589], 99.50th=[31851], 99.90th=[32637], 99.95th=[32637], 00:14:26.506 | 99.99th=[32900] 00:14:26.506 bw ( KiB/s): min=16384, max=21312, per=19.49%, avg=18848.00, stdev=3484.62, samples=2 00:14:26.506 iops : min= 4096, max= 5328, avg=4712.00, stdev=871.16, samples=2 00:14:26.506 lat (msec) : 4=0.41%, 10=11.26%, 20=83.53%, 50=4.80% 00:14:26.506 cpu : usr=2.09%, sys=4.39%, ctx=724, majf=0, minf=1 00:14:26.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:14:26.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:26.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:26.506 issued rwts: total=4608,4839,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:26.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:26.506 job3: (groupid=0, jobs=1): err= 0: pid=956549: Fri Apr 26 18:02:35 2024 00:14:26.506 read: IOPS=6600, BW=25.8MiB/s (27.0MB/s)(25.8MiB/1002msec) 00:14:26.506 slat (usec): min=2, max=6509, avg=76.77, stdev=406.40 00:14:26.506 clat (usec): min=410, max=29201, avg=9965.29, stdev=5112.98 00:14:26.506 lat (usec): min=1348, max=29205, avg=10042.07, stdev=5140.48 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3621], 5.00th=[ 4555], 10.00th=[ 5407], 20.00th=[ 6587], 00:14:26.506 | 30.00th=[ 7046], 40.00th=[ 7504], 50.00th=[ 8029], 60.00th=[ 9110], 00:14:26.506 | 70.00th=[10814], 80.00th=[13042], 90.00th=[16712], 95.00th=[22938], 00:14:26.506 | 99.00th=[26608], 99.50th=[27395], 99.90th=[28443], 99.95th=[28705], 00:14:26.506 | 99.99th=[29230] 00:14:26.506 write: IOPS=6642, BW=25.9MiB/s (27.2MB/s)(26.0MiB/1002msec); 0 zone resets 00:14:26.506 slat (usec): min=2, max=5787, avg=69.27, stdev=346.53 00:14:26.506 clat (usec): min=2783, max=25277, avg=9153.08, stdev=4625.35 00:14:26.506 lat (usec): min=2888, max=25289, avg=9222.35, stdev=4654.73 00:14:26.506 clat percentiles (usec): 00:14:26.506 | 1.00th=[ 3359], 5.00th=[ 5014], 10.00th=[ 5538], 20.00th=[ 6194], 00:14:26.506 | 30.00th=[ 6521], 40.00th=[ 6849], 50.00th=[ 7242], 60.00th=[ 7898], 00:14:26.506 | 70.00th=[ 9372], 80.00th=[11600], 90.00th=[15926], 95.00th=[20055], 00:14:26.506 | 99.00th=[24773], 99.50th=[24773], 99.90th=[25297], 99.95th=[25297], 00:14:26.506 | 99.99th=[25297] 00:14:26.506 bw ( KiB/s): min=20720, max=32528, per=27.53%, avg=26624.00, stdev=8349.52, samples=2 00:14:26.506 iops : min= 5180, max= 8132, avg=6656.00, stdev=2087.38, samples=2 00:14:26.506 lat (usec) : 500=0.01% 00:14:26.506 lat (msec) : 2=0.11%, 4=1.42%, 10=68.24%, 20=24.48%, 50=5.74% 00:14:26.506 cpu : usr=3.40%, sys=6.39%, ctx=1172, majf=0, minf=1 00:14:26.506 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.2%, >=64=99.5% 00:14:26.506 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:26.506 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:14:26.506 issued rwts: total=6614,6656,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:26.506 latency : target=0, window=0, percentile=100.00%, depth=128 00:14:26.506 00:14:26.506 Run status group 0 (all jobs): 00:14:26.506 READ: bw=90.7MiB/s (95.1MB/s), 17.9MiB/s-25.8MiB/s (18.8MB/s-27.0MB/s), io=91.1MiB (95.6MB), run=1002-1005msec 00:14:26.506 WRITE: bw=94.4MiB/s (99.0MB/s), 18.8MiB/s-25.9MiB/s (19.7MB/s-27.2MB/s), io=94.9MiB (99.5MB), run=1002-1005msec 00:14:26.506 00:14:26.506 Disk stats (read/write): 00:14:26.506 nvme0n1: ios=5326/5632, merge=0/0, ticks=16916/15867, in_queue=32783, util=83.07% 00:14:26.506 nvme0n2: ios=5409/5632, merge=0/0, ticks=13959/14360, in_queue=28319, util=84.27% 00:14:26.506 nvme0n3: ios=3584/4044, merge=0/0, ticks=16701/19346, in_queue=36047, util=87.99% 00:14:26.506 nvme0n4: ios=5120/5283, merge=0/0, ticks=17766/18072, in_queue=35838, util=89.33% 00:14:26.506 18:02:35 -- target/fio.sh@55 -- # sync 00:14:26.506 18:02:35 -- target/fio.sh@59 -- # fio_pid=956727 00:14:26.506 18:02:35 -- target/fio.sh@61 -- # sleep 3 00:14:26.506 18:02:35 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:14:26.506 [global] 00:14:26.506 thread=1 00:14:26.506 invalidate=1 00:14:26.506 rw=read 00:14:26.506 time_based=1 00:14:26.506 runtime=10 00:14:26.506 ioengine=libaio 00:14:26.506 direct=1 00:14:26.506 bs=4096 00:14:26.506 iodepth=1 00:14:26.506 norandommap=1 00:14:26.506 numjobs=1 00:14:26.506 00:14:26.506 [job0] 00:14:26.506 filename=/dev/nvme0n1 00:14:26.506 [job1] 00:14:26.506 filename=/dev/nvme0n2 00:14:26.506 [job2] 00:14:26.506 filename=/dev/nvme0n3 00:14:26.506 [job3] 00:14:26.506 filename=/dev/nvme0n4 00:14:26.506 Could not set queue depth (nvme0n1) 00:14:26.506 Could not set queue depth (nvme0n2) 00:14:26.506 Could not set queue depth (nvme0n3) 00:14:26.506 Could not set queue depth (nvme0n4) 00:14:26.506 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:26.506 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:26.506 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:26.506 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:14:26.506 fio-3.35 00:14:26.506 Starting 4 threads 00:14:29.797 18:02:38 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:14:29.797 fio: io_u error on file /dev/nvme0n4: Remote I/O error: read offset=78426112, buflen=4096 00:14:29.797 fio: pid=956852, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:29.797 18:02:38 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:14:29.797 fio: io_u error on file /dev/nvme0n3: Remote I/O error: read offset=95727616, buflen=4096 00:14:29.797 fio: pid=956851, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:29.797 18:02:38 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:29.797 18:02:38 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:14:29.797 fio: io_u error on file /dev/nvme0n1: Remote I/O error: read offset=36732928, buflen=4096 00:14:29.797 fio: pid=956849, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:30.057 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.057 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:14:30.057 fio: io_u error on file /dev/nvme0n2: Remote I/O error: read offset=59908096, buflen=4096 00:14:30.057 fio: pid=956850, err=121/file:io_u.c:1889, func=io_u error, error=Remote I/O error 00:14:30.057 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.057 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:14:30.057 00:14:30.057 job0: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=956849: Fri Apr 26 18:02:39 2024 00:14:30.057 read: IOPS=8131, BW=31.8MiB/s (33.3MB/s)(99.0MiB/3118msec) 00:14:30.057 slat (usec): min=8, max=8667, avg=10.41, stdev=96.57 00:14:30.057 clat (usec): min=51, max=592, avg=111.14, stdev=21.32 00:14:30.057 lat (usec): min=59, max=8759, avg=121.56, stdev=98.88 00:14:30.057 clat percentiles (usec): 00:14:30.057 | 1.00th=[ 68], 5.00th=[ 78], 10.00th=[ 82], 20.00th=[ 90], 00:14:30.057 | 30.00th=[ 103], 40.00th=[ 111], 50.00th=[ 115], 60.00th=[ 118], 00:14:30.057 | 70.00th=[ 122], 80.00th=[ 127], 90.00th=[ 135], 95.00th=[ 141], 00:14:30.057 | 99.00th=[ 157], 99.50th=[ 180], 99.90th=[ 239], 99.95th=[ 277], 00:14:30.057 | 99.99th=[ 359] 00:14:30.057 bw ( KiB/s): min=28064, max=37875, per=27.30%, avg=32452.50, stdev=3247.80, samples=6 00:14:30.057 iops : min= 7016, max= 9468, avg=8113.00, stdev=811.70, samples=6 00:14:30.057 lat (usec) : 100=27.34%, 250=72.58%, 500=0.07%, 750=0.01% 00:14:30.057 cpu : usr=2.92%, sys=8.89%, ctx=25358, majf=0, minf=1 00:14:30.057 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:30.057 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 issued rwts: total=25353,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:30.057 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:30.057 job1: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=956850: Fri Apr 26 18:02:39 2024 00:14:30.057 read: IOPS=9321, BW=36.4MiB/s (38.2MB/s)(121MiB/3327msec) 00:14:30.057 slat (usec): min=7, max=13890, avg=11.16, stdev=149.12 00:14:30.057 clat (usec): min=50, max=350, avg=94.79, stdev=19.94 00:14:30.057 lat (usec): min=60, max=13977, avg=105.95, stdev=150.31 00:14:30.057 clat percentiles (usec): 00:14:30.057 | 1.00th=[ 58], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 79], 00:14:30.057 | 30.00th=[ 82], 40.00th=[ 85], 50.00th=[ 89], 60.00th=[ 104], 00:14:30.057 | 70.00th=[ 112], 80.00th=[ 116], 90.00th=[ 120], 95.00th=[ 123], 00:14:30.057 | 99.00th=[ 133], 99.50th=[ 141], 99.90th=[ 165], 99.95th=[ 188], 00:14:30.057 | 99.99th=[ 293] 00:14:30.057 bw ( KiB/s): min=32304, max=42752, per=30.69%, avg=36479.50, stdev=4629.74, samples=6 00:14:30.057 iops : min= 8076, max=10688, avg=9119.83, stdev=1157.39, samples=6 00:14:30.057 lat (usec) : 100=57.21%, 250=42.78%, 500=0.02% 00:14:30.057 cpu : usr=3.22%, sys=10.07%, ctx=31019, majf=0, minf=1 00:14:30.057 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:30.057 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 issued rwts: total=31011,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:30.057 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:30.057 job2: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=956851: Fri Apr 26 18:02:39 2024 00:14:30.057 read: IOPS=8023, BW=31.3MiB/s (32.9MB/s)(91.3MiB/2913msec) 00:14:30.057 slat (usec): min=8, max=15919, avg=10.33, stdev=116.12 00:14:30.057 clat (usec): min=62, max=389, avg=112.83, stdev=20.64 00:14:30.057 lat (usec): min=71, max=16035, avg=123.16, stdev=117.93 00:14:30.057 clat percentiles (usec): 00:14:30.057 | 1.00th=[ 83], 5.00th=[ 86], 10.00th=[ 88], 20.00th=[ 91], 00:14:30.057 | 30.00th=[ 95], 40.00th=[ 99], 50.00th=[ 117], 60.00th=[ 127], 00:14:30.057 | 70.00th=[ 130], 80.00th=[ 133], 90.00th=[ 137], 95.00th=[ 141], 00:14:30.057 | 99.00th=[ 149], 99.50th=[ 159], 99.90th=[ 180], 99.95th=[ 215], 00:14:30.057 | 99.99th=[ 293] 00:14:30.057 bw ( KiB/s): min=28232, max=38784, per=26.68%, avg=31716.80, stdev=4824.37, samples=5 00:14:30.057 iops : min= 7058, max= 9696, avg=7929.20, stdev=1206.09, samples=5 00:14:30.057 lat (usec) : 100=41.10%, 250=58.87%, 500=0.02% 00:14:30.057 cpu : usr=2.92%, sys=8.79%, ctx=23374, majf=0, minf=1 00:14:30.057 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:30.057 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.057 issued rwts: total=23372,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:30.057 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:30.057 job3: (groupid=0, jobs=1): err=121 (file:io_u.c:1889, func=io_u error, error=Remote I/O error): pid=956852: Fri Apr 26 18:02:39 2024 00:14:30.057 read: IOPS=7039, BW=27.5MiB/s (28.8MB/s)(74.8MiB/2720msec) 00:14:30.057 slat (nsec): min=8523, max=49155, avg=9469.01, stdev=1039.74 00:14:30.058 clat (usec): min=78, max=398, avg=130.99, stdev=16.91 00:14:30.058 lat (usec): min=88, max=407, avg=140.46, stdev=16.95 00:14:30.058 clat percentiles (usec): 00:14:30.058 | 1.00th=[ 89], 5.00th=[ 108], 10.00th=[ 119], 20.00th=[ 125], 00:14:30.058 | 30.00th=[ 127], 40.00th=[ 129], 50.00th=[ 131], 60.00th=[ 133], 00:14:30.058 | 70.00th=[ 135], 80.00th=[ 137], 90.00th=[ 143], 95.00th=[ 147], 00:14:30.058 | 99.00th=[ 196], 99.50th=[ 227], 99.90th=[ 277], 99.95th=[ 302], 00:14:30.058 | 99.99th=[ 400] 00:14:30.058 bw ( KiB/s): min=27864, max=28256, per=23.54%, avg=27984.00, stdev=159.30, samples=5 00:14:30.058 iops : min= 6966, max= 7064, avg=6996.00, stdev=39.82, samples=5 00:14:30.058 lat (usec) : 100=4.10%, 250=95.62%, 500=0.27% 00:14:30.058 cpu : usr=2.76%, sys=7.61%, ctx=19149, majf=0, minf=2 00:14:30.058 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:14:30.058 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.058 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:14:30.058 issued rwts: total=19148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:14:30.058 latency : target=0, window=0, percentile=100.00%, depth=1 00:14:30.058 00:14:30.058 Run status group 0 (all jobs): 00:14:30.058 READ: bw=116MiB/s (122MB/s), 27.5MiB/s-36.4MiB/s (28.8MB/s-38.2MB/s), io=386MiB (405MB), run=2720-3327msec 00:14:30.058 00:14:30.058 Disk stats (read/write): 00:14:30.058 nvme0n1: ios=25238/0, merge=0/0, ticks=2680/0, in_queue=2680, util=94.67% 00:14:30.058 nvme0n2: ios=28337/0, merge=0/0, ticks=2636/0, in_queue=2636, util=94.86% 00:14:30.058 nvme0n3: ios=22835/0, merge=0/0, ticks=2468/0, in_queue=2468, util=95.73% 00:14:30.058 nvme0n4: ios=18149/0, merge=0/0, ticks=2263/0, in_queue=2263, util=96.44% 00:14:30.317 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.317 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:14:30.577 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.577 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:14:30.836 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.836 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:14:30.836 18:02:39 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:14:30.836 18:02:39 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:14:31.095 18:02:40 -- target/fio.sh@69 -- # fio_status=0 00:14:31.095 18:02:40 -- target/fio.sh@70 -- # wait 956727 00:14:31.095 18:02:40 -- target/fio.sh@70 -- # fio_status=4 00:14:31.095 18:02:40 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:32.042 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:32.042 18:02:41 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:32.042 18:02:41 -- common/autotest_common.sh@1215 -- # local i=0 00:14:32.042 18:02:41 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:14:32.042 18:02:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:32.042 18:02:41 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:14:32.042 18:02:41 -- common/autotest_common.sh@1223 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:32.042 18:02:41 -- common/autotest_common.sh@1227 -- # return 0 00:14:32.042 18:02:41 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:14:32.042 18:02:41 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:14:32.042 nvmf hotplug test: fio failed as expected 00:14:32.042 18:02:41 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:32.302 18:02:41 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:14:32.302 18:02:41 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:14:32.302 18:02:41 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:14:32.302 18:02:41 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:14:32.302 18:02:41 -- target/fio.sh@91 -- # nvmftestfini 00:14:32.302 18:02:41 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:32.302 18:02:41 -- nvmf/common.sh@117 -- # sync 00:14:32.302 18:02:41 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:32.302 18:02:41 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:32.302 18:02:41 -- nvmf/common.sh@120 -- # set +e 00:14:32.302 18:02:41 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:32.302 18:02:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:32.302 rmmod nvme_rdma 00:14:32.302 rmmod nvme_fabrics 00:14:32.302 18:02:41 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:32.302 18:02:41 -- nvmf/common.sh@124 -- # set -e 00:14:32.302 18:02:41 -- nvmf/common.sh@125 -- # return 0 00:14:32.302 18:02:41 -- nvmf/common.sh@478 -- # '[' -n 954373 ']' 00:14:32.302 18:02:41 -- nvmf/common.sh@479 -- # killprocess 954373 00:14:32.302 18:02:41 -- common/autotest_common.sh@946 -- # '[' -z 954373 ']' 00:14:32.302 18:02:41 -- common/autotest_common.sh@950 -- # kill -0 954373 00:14:32.302 18:02:41 -- common/autotest_common.sh@951 -- # uname 00:14:32.302 18:02:41 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:32.302 18:02:41 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 954373 00:14:32.302 18:02:41 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:14:32.302 18:02:41 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:14:32.302 18:02:41 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 954373' 00:14:32.302 killing process with pid 954373 00:14:32.302 18:02:41 -- common/autotest_common.sh@965 -- # kill 954373 00:14:32.302 18:02:41 -- common/autotest_common.sh@970 -- # wait 954373 00:14:32.561 [2024-04-26 18:02:41.521876] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:32.562 18:02:41 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:32.562 18:02:41 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:32.822 00:14:32.822 real 0m25.762s 00:14:32.822 user 1m37.732s 00:14:32.822 sys 0m9.542s 00:14:32.822 18:02:41 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:32.822 18:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:32.822 ************************************ 00:14:32.822 END TEST nvmf_fio_target 00:14:32.822 ************************************ 00:14:32.822 18:02:41 -- nvmf/nvmf.sh@56 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:14:32.822 18:02:41 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:32.822 18:02:41 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:32.822 18:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:32.822 ************************************ 00:14:32.822 START TEST nvmf_bdevio 00:14:32.822 ************************************ 00:14:32.822 18:02:41 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=rdma 00:14:33.081 * Looking for test storage... 00:14:33.081 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:33.081 18:02:42 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:33.081 18:02:42 -- nvmf/common.sh@7 -- # uname -s 00:14:33.081 18:02:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:33.081 18:02:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:33.081 18:02:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:33.081 18:02:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:33.081 18:02:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:33.081 18:02:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:33.081 18:02:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:33.081 18:02:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:33.081 18:02:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:33.081 18:02:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:33.081 18:02:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:14:33.081 18:02:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:14:33.081 18:02:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:33.081 18:02:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:33.081 18:02:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:33.081 18:02:42 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:33.081 18:02:42 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:33.081 18:02:42 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:33.081 18:02:42 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:33.081 18:02:42 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:33.081 18:02:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.081 18:02:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.081 18:02:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.081 18:02:42 -- paths/export.sh@5 -- # export PATH 00:14:33.081 18:02:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:33.081 18:02:42 -- nvmf/common.sh@47 -- # : 0 00:14:33.081 18:02:42 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:33.081 18:02:42 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:33.081 18:02:42 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:33.081 18:02:42 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:33.081 18:02:42 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:33.081 18:02:42 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:33.081 18:02:42 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:33.081 18:02:42 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:33.081 18:02:42 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:33.081 18:02:42 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:33.081 18:02:42 -- target/bdevio.sh@14 -- # nvmftestinit 00:14:33.081 18:02:42 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:33.081 18:02:42 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:33.081 18:02:42 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:33.081 18:02:42 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:33.081 18:02:42 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:33.081 18:02:42 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.081 18:02:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.081 18:02:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:33.081 18:02:42 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:33.081 18:02:42 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:33.081 18:02:42 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:33.081 18:02:42 -- common/autotest_common.sh@10 -- # set +x 00:14:39.649 18:02:48 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:39.649 18:02:48 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:39.649 18:02:48 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:39.649 18:02:48 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:39.649 18:02:48 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:39.649 18:02:48 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:39.649 18:02:48 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:39.649 18:02:48 -- nvmf/common.sh@295 -- # net_devs=() 00:14:39.649 18:02:48 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:39.649 18:02:48 -- nvmf/common.sh@296 -- # e810=() 00:14:39.649 18:02:48 -- nvmf/common.sh@296 -- # local -ga e810 00:14:39.649 18:02:48 -- nvmf/common.sh@297 -- # x722=() 00:14:39.649 18:02:48 -- nvmf/common.sh@297 -- # local -ga x722 00:14:39.649 18:02:48 -- nvmf/common.sh@298 -- # mlx=() 00:14:39.649 18:02:48 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:39.649 18:02:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:39.649 18:02:48 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:39.649 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:39.649 18:02:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:39.649 18:02:48 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:39.649 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:39.649 18:02:48 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:39.649 18:02:48 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.649 18:02:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.649 18:02:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:39.649 Found net devices under 0000:18:00.0: mlx_0_0 00:14:39.649 18:02:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:39.649 18:02:48 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:39.649 18:02:48 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:39.649 Found net devices under 0000:18:00.1: mlx_0_1 00:14:39.649 18:02:48 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:39.649 18:02:48 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:39.649 18:02:48 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:39.649 18:02:48 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:39.649 18:02:48 -- nvmf/common.sh@58 -- # uname 00:14:39.649 18:02:48 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:39.649 18:02:48 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:39.649 18:02:48 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:39.649 18:02:48 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:39.649 18:02:48 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:39.649 18:02:48 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:39.649 18:02:48 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:39.649 18:02:48 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:39.649 18:02:48 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:39.649 18:02:48 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:39.649 18:02:48 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:39.649 18:02:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:39.649 18:02:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:39.649 18:02:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:39.649 18:02:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:39.649 18:02:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:39.649 18:02:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:39.649 18:02:48 -- nvmf/common.sh@105 -- # continue 2 00:14:39.649 18:02:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.649 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:39.649 18:02:48 -- nvmf/common.sh@105 -- # continue 2 00:14:39.649 18:02:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:39.649 18:02:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:39.649 18:02:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.649 18:02:48 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:39.649 18:02:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:39.649 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:39.649 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:39.649 altname enp24s0f0np0 00:14:39.649 altname ens785f0np0 00:14:39.649 inet 192.168.100.8/24 scope global mlx_0_0 00:14:39.649 valid_lft forever preferred_lft forever 00:14:39.649 18:02:48 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:39.649 18:02:48 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:39.649 18:02:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.649 18:02:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.649 18:02:48 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:39.649 18:02:48 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:39.649 18:02:48 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:39.649 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:39.649 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:39.649 altname enp24s0f1np1 00:14:39.649 altname ens785f1np1 00:14:39.649 inet 192.168.100.9/24 scope global mlx_0_1 00:14:39.649 valid_lft forever preferred_lft forever 00:14:39.649 18:02:48 -- nvmf/common.sh@411 -- # return 0 00:14:39.650 18:02:48 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:39.650 18:02:48 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:39.650 18:02:48 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:39.650 18:02:48 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:39.650 18:02:48 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:39.650 18:02:48 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:39.650 18:02:48 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:39.650 18:02:48 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:39.650 18:02:48 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:39.650 18:02:48 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:39.650 18:02:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.650 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.650 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:39.650 18:02:48 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:39.650 18:02:48 -- nvmf/common.sh@105 -- # continue 2 00:14:39.650 18:02:48 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:39.650 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.650 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:39.650 18:02:48 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:39.650 18:02:48 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:39.650 18:02:48 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:39.650 18:02:48 -- nvmf/common.sh@105 -- # continue 2 00:14:39.650 18:02:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:39.650 18:02:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:39.650 18:02:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.650 18:02:48 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:39.650 18:02:48 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:39.650 18:02:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:39.650 18:02:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:39.650 18:02:48 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:39.650 192.168.100.9' 00:14:39.650 18:02:48 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:39.650 192.168.100.9' 00:14:39.650 18:02:48 -- nvmf/common.sh@446 -- # head -n 1 00:14:39.650 18:02:48 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:39.650 18:02:48 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:39.650 192.168.100.9' 00:14:39.650 18:02:48 -- nvmf/common.sh@447 -- # tail -n +2 00:14:39.650 18:02:48 -- nvmf/common.sh@447 -- # head -n 1 00:14:39.650 18:02:48 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:39.650 18:02:48 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:39.650 18:02:48 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:39.650 18:02:48 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:39.650 18:02:48 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:39.650 18:02:48 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:39.650 18:02:48 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:14:39.650 18:02:48 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:39.650 18:02:48 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:39.650 18:02:48 -- common/autotest_common.sh@10 -- # set +x 00:14:39.650 18:02:48 -- nvmf/common.sh@470 -- # nvmfpid=960513 00:14:39.650 18:02:48 -- nvmf/common.sh@471 -- # waitforlisten 960513 00:14:39.650 18:02:48 -- common/autotest_common.sh@827 -- # '[' -z 960513 ']' 00:14:39.650 18:02:48 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:39.650 18:02:48 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:39.650 18:02:48 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:39.650 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:39.650 18:02:48 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:39.650 18:02:48 -- common/autotest_common.sh@10 -- # set +x 00:14:39.650 18:02:48 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:14:39.650 [2024-04-26 18:02:48.303566] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:14:39.650 [2024-04-26 18:02:48.303622] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:39.650 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.650 [2024-04-26 18:02:48.375503] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:39.650 [2024-04-26 18:02:48.461235] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:39.650 [2024-04-26 18:02:48.461275] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:39.650 [2024-04-26 18:02:48.461285] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:39.650 [2024-04-26 18:02:48.461294] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:39.650 [2024-04-26 18:02:48.461302] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:39.650 [2024-04-26 18:02:48.461439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:39.650 [2024-04-26 18:02:48.461559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:14:39.650 [2024-04-26 18:02:48.461658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:39.650 [2024-04-26 18:02:48.461659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:14:40.218 18:02:49 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:40.218 18:02:49 -- common/autotest_common.sh@860 -- # return 0 00:14:40.218 18:02:49 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:40.218 18:02:49 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:40.218 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.218 18:02:49 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:40.218 18:02:49 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:14:40.218 18:02:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.218 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.218 [2024-04-26 18:02:49.176180] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1412db0/0x14172a0) succeed. 00:14:40.218 [2024-04-26 18:02:49.186831] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x14143f0/0x1458930) succeed. 00:14:40.218 18:02:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.218 18:02:49 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:40.218 18:02:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.218 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.218 Malloc0 00:14:40.218 18:02:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.218 18:02:49 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:14:40.218 18:02:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.218 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.218 18:02:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.218 18:02:49 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:40.219 18:02:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.219 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.219 18:02:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.219 18:02:49 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:14:40.219 18:02:49 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.219 18:02:49 -- common/autotest_common.sh@10 -- # set +x 00:14:40.219 [2024-04-26 18:02:49.357688] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:40.219 18:02:49 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.219 18:02:49 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:14:40.219 18:02:49 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:14:40.219 18:02:49 -- nvmf/common.sh@521 -- # config=() 00:14:40.219 18:02:49 -- nvmf/common.sh@521 -- # local subsystem config 00:14:40.219 18:02:49 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:14:40.219 18:02:49 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:14:40.219 { 00:14:40.219 "params": { 00:14:40.219 "name": "Nvme$subsystem", 00:14:40.219 "trtype": "$TEST_TRANSPORT", 00:14:40.219 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:40.219 "adrfam": "ipv4", 00:14:40.219 "trsvcid": "$NVMF_PORT", 00:14:40.219 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:40.219 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:40.219 "hdgst": ${hdgst:-false}, 00:14:40.219 "ddgst": ${ddgst:-false} 00:14:40.219 }, 00:14:40.219 "method": "bdev_nvme_attach_controller" 00:14:40.219 } 00:14:40.219 EOF 00:14:40.219 )") 00:14:40.219 18:02:49 -- nvmf/common.sh@543 -- # cat 00:14:40.219 18:02:49 -- nvmf/common.sh@545 -- # jq . 00:14:40.219 18:02:49 -- nvmf/common.sh@546 -- # IFS=, 00:14:40.219 18:02:49 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:14:40.219 "params": { 00:14:40.219 "name": "Nvme1", 00:14:40.219 "trtype": "rdma", 00:14:40.219 "traddr": "192.168.100.8", 00:14:40.219 "adrfam": "ipv4", 00:14:40.219 "trsvcid": "4420", 00:14:40.219 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:14:40.219 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:14:40.219 "hdgst": false, 00:14:40.219 "ddgst": false 00:14:40.219 }, 00:14:40.219 "method": "bdev_nvme_attach_controller" 00:14:40.219 }' 00:14:40.219 [2024-04-26 18:02:49.410380] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:14:40.219 [2024-04-26 18:02:49.410442] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid960711 ] 00:14:40.478 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.478 [2024-04-26 18:02:49.484057] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:40.478 [2024-04-26 18:02:49.567740] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:40.478 [2024-04-26 18:02:49.567825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:40.478 [2024-04-26 18:02:49.567827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:40.738 I/O targets: 00:14:40.738 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:14:40.738 00:14:40.738 00:14:40.738 CUnit - A unit testing framework for C - Version 2.1-3 00:14:40.738 http://cunit.sourceforge.net/ 00:14:40.738 00:14:40.738 00:14:40.738 Suite: bdevio tests on: Nvme1n1 00:14:40.738 Test: blockdev write read block ...passed 00:14:40.738 Test: blockdev write zeroes read block ...passed 00:14:40.738 Test: blockdev write zeroes read no split ...passed 00:14:40.738 Test: blockdev write zeroes read split ...passed 00:14:40.738 Test: blockdev write zeroes read split partial ...passed 00:14:40.739 Test: blockdev reset ...[2024-04-26 18:02:49.776851] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:14:40.739 [2024-04-26 18:02:49.799862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:14:40.739 [2024-04-26 18:02:49.826481] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:40.739 passed 00:14:40.739 Test: blockdev write read 8 blocks ...passed 00:14:40.739 Test: blockdev write read size > 128k ...passed 00:14:40.739 Test: blockdev write read invalid size ...passed 00:14:40.739 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:14:40.739 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:14:40.739 Test: blockdev write read max offset ...passed 00:14:40.739 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:14:40.739 Test: blockdev writev readv 8 blocks ...passed 00:14:40.739 Test: blockdev writev readv 30 x 1block ...passed 00:14:40.739 Test: blockdev writev readv block ...passed 00:14:40.739 Test: blockdev writev readv size > 128k ...passed 00:14:40.739 Test: blockdev writev readv size > 128k in two iovs ...passed 00:14:40.739 Test: blockdev comparev and writev ...[2024-04-26 18:02:49.829443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.829485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.829653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.829676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.829858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.829880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.829889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.830068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.830079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.830090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:14:40.739 [2024-04-26 18:02:49.830099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:14:40.739 passed 00:14:40.739 Test: blockdev nvme passthru rw ...passed 00:14:40.739 Test: blockdev nvme passthru vendor specific ...[2024-04-26 18:02:49.830372] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:40.739 [2024-04-26 18:02:49.830385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.830425] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:40.739 [2024-04-26 18:02:49.830435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.830478] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:40.739 [2024-04-26 18:02:49.830488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:14:40.739 [2024-04-26 18:02:49.830529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:14:40.739 [2024-04-26 18:02:49.830540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:14:40.739 passed 00:14:40.739 Test: blockdev nvme admin passthru ...passed 00:14:40.739 Test: blockdev copy ...passed 00:14:40.739 00:14:40.739 Run Summary: Type Total Ran Passed Failed Inactive 00:14:40.739 suites 1 1 n/a 0 0 00:14:40.739 tests 23 23 23 0 0 00:14:40.739 asserts 152 152 152 0 n/a 00:14:40.739 00:14:40.739 Elapsed time = 0.176 seconds 00:14:40.998 18:02:50 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:40.998 18:02:50 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:40.998 18:02:50 -- common/autotest_common.sh@10 -- # set +x 00:14:40.998 18:02:50 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:40.998 18:02:50 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:14:40.998 18:02:50 -- target/bdevio.sh@30 -- # nvmftestfini 00:14:40.998 18:02:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:14:40.998 18:02:50 -- nvmf/common.sh@117 -- # sync 00:14:40.998 18:02:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:14:40.998 18:02:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:14:40.998 18:02:50 -- nvmf/common.sh@120 -- # set +e 00:14:40.998 18:02:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:14:40.998 18:02:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:14:40.998 rmmod nvme_rdma 00:14:40.998 rmmod nvme_fabrics 00:14:40.998 18:02:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:14:40.998 18:02:50 -- nvmf/common.sh@124 -- # set -e 00:14:40.998 18:02:50 -- nvmf/common.sh@125 -- # return 0 00:14:40.998 18:02:50 -- nvmf/common.sh@478 -- # '[' -n 960513 ']' 00:14:40.998 18:02:50 -- nvmf/common.sh@479 -- # killprocess 960513 00:14:40.998 18:02:50 -- common/autotest_common.sh@946 -- # '[' -z 960513 ']' 00:14:40.998 18:02:50 -- common/autotest_common.sh@950 -- # kill -0 960513 00:14:40.998 18:02:50 -- common/autotest_common.sh@951 -- # uname 00:14:40.998 18:02:50 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:14:40.998 18:02:50 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 960513 00:14:40.998 18:02:50 -- common/autotest_common.sh@952 -- # process_name=reactor_3 00:14:40.998 18:02:50 -- common/autotest_common.sh@956 -- # '[' reactor_3 = sudo ']' 00:14:40.998 18:02:50 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 960513' 00:14:40.998 killing process with pid 960513 00:14:40.998 18:02:50 -- common/autotest_common.sh@965 -- # kill 960513 00:14:40.998 18:02:50 -- common/autotest_common.sh@970 -- # wait 960513 00:14:41.257 [2024-04-26 18:02:50.270125] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:14:41.517 18:02:50 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:14:41.517 18:02:50 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:14:41.517 00:14:41.517 real 0m8.564s 00:14:41.517 user 0m10.979s 00:14:41.517 sys 0m5.280s 00:14:41.517 18:02:50 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:14:41.517 18:02:50 -- common/autotest_common.sh@10 -- # set +x 00:14:41.517 ************************************ 00:14:41.517 END TEST nvmf_bdevio 00:14:41.517 ************************************ 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@58 -- # '[' rdma = tcp ']' 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@64 -- # '[' 0 -eq 1 ']' 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@70 -- # [[ phy == phy ]] 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@71 -- # '[' rdma = tcp ']' 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@77 -- # [[ rdma == \r\d\m\a ]] 00:14:41.517 18:02:50 -- nvmf/nvmf.sh@78 -- # run_test nvmf_device_removal test/nvmf/target/device_removal.sh --transport=rdma 00:14:41.517 18:02:50 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:41.517 18:02:50 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:41.517 18:02:50 -- common/autotest_common.sh@10 -- # set +x 00:14:41.778 ************************************ 00:14:41.778 START TEST nvmf_device_removal 00:14:41.778 ************************************ 00:14:41.778 18:02:50 -- common/autotest_common.sh@1121 -- # test/nvmf/target/device_removal.sh --transport=rdma 00:14:41.778 * Looking for test storage... 00:14:41.778 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:41.778 18:02:50 -- target/device_removal.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/autotest_common.sh 00:14:41.778 18:02:50 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:14:41.778 18:02:50 -- common/autotest_common.sh@34 -- # set -e 00:14:41.778 18:02:50 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:14:41.778 18:02:50 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:14:41.778 18:02:50 -- common/autotest_common.sh@38 -- # '[' -z /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output ']' 00:14:41.778 18:02:50 -- common/autotest_common.sh@43 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh ]] 00:14:41.778 18:02:50 -- common/autotest_common.sh@44 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/build_config.sh 00:14:41.778 18:02:50 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:14:41.778 18:02:50 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:14:41.778 18:02:50 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:14:41.778 18:02:50 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:14:41.778 18:02:50 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:14:41.778 18:02:50 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:14:41.779 18:02:50 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:14:41.779 18:02:50 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:14:41.779 18:02:50 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:14:41.779 18:02:50 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:14:41.779 18:02:50 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:14:41.779 18:02:50 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:14:41.779 18:02:50 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:14:41.779 18:02:50 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:14:41.779 18:02:50 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:14:41.779 18:02:50 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:14:41.779 18:02:50 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:14:41.779 18:02:50 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:14:41.779 18:02:50 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:14:41.779 18:02:50 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:14:41.779 18:02:50 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:14:41.779 18:02:50 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:14:41.779 18:02:50 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:14:41.779 18:02:50 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:14:41.779 18:02:50 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:14:41.779 18:02:50 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:14:41.779 18:02:50 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:14:41.779 18:02:50 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:14:41.779 18:02:50 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:14:41.779 18:02:50 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:14:41.779 18:02:50 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:14:41.779 18:02:50 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:14:41.779 18:02:50 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:14:41.779 18:02:50 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:14:41.779 18:02:50 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:14:41.779 18:02:50 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:14:41.779 18:02:50 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:14:41.779 18:02:50 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:14:41.779 18:02:50 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:14:41.779 18:02:50 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:14:41.779 18:02:50 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:14:41.779 18:02:50 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:14:41.779 18:02:50 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:14:41.779 18:02:50 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:14:41.779 18:02:50 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:14:41.779 18:02:50 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:14:41.779 18:02:50 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:14:41.779 18:02:50 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:14:41.779 18:02:50 -- common/build_config.sh@53 -- # CONFIG_HAVE_EVP_MAC=y 00:14:41.779 18:02:50 -- common/build_config.sh@54 -- # CONFIG_URING_ZNS=n 00:14:41.779 18:02:50 -- common/build_config.sh@55 -- # CONFIG_WERROR=y 00:14:41.779 18:02:50 -- common/build_config.sh@56 -- # CONFIG_HAVE_LIBBSD=n 00:14:41.779 18:02:50 -- common/build_config.sh@57 -- # CONFIG_UBSAN=y 00:14:41.779 18:02:50 -- common/build_config.sh@58 -- # CONFIG_IPSEC_MB_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@59 -- # CONFIG_GOLANG=n 00:14:41.779 18:02:50 -- common/build_config.sh@60 -- # CONFIG_ISAL=y 00:14:41.779 18:02:50 -- common/build_config.sh@61 -- # CONFIG_IDXD_KERNEL=n 00:14:41.779 18:02:50 -- common/build_config.sh@62 -- # CONFIG_DPDK_LIB_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@63 -- # CONFIG_RDMA_PROV=verbs 00:14:41.779 18:02:50 -- common/build_config.sh@64 -- # CONFIG_APPS=y 00:14:41.779 18:02:50 -- common/build_config.sh@65 -- # CONFIG_SHARED=y 00:14:41.779 18:02:50 -- common/build_config.sh@66 -- # CONFIG_HAVE_KEYUTILS=n 00:14:41.779 18:02:50 -- common/build_config.sh@67 -- # CONFIG_FC_PATH= 00:14:41.779 18:02:50 -- common/build_config.sh@68 -- # CONFIG_DPDK_PKG_CONFIG=n 00:14:41.779 18:02:50 -- common/build_config.sh@69 -- # CONFIG_FC=n 00:14:41.779 18:02:50 -- common/build_config.sh@70 -- # CONFIG_AVAHI=n 00:14:41.779 18:02:50 -- common/build_config.sh@71 -- # CONFIG_FIO_PLUGIN=y 00:14:41.779 18:02:50 -- common/build_config.sh@72 -- # CONFIG_RAID5F=n 00:14:41.779 18:02:50 -- common/build_config.sh@73 -- # CONFIG_EXAMPLES=y 00:14:41.779 18:02:50 -- common/build_config.sh@74 -- # CONFIG_TESTS=y 00:14:41.779 18:02:50 -- common/build_config.sh@75 -- # CONFIG_CRYPTO_MLX5=n 00:14:41.779 18:02:50 -- common/build_config.sh@76 -- # CONFIG_MAX_LCORES= 00:14:41.779 18:02:50 -- common/build_config.sh@77 -- # CONFIG_IPSEC_MB=n 00:14:41.779 18:02:50 -- common/build_config.sh@78 -- # CONFIG_PGO_DIR= 00:14:41.779 18:02:50 -- common/build_config.sh@79 -- # CONFIG_DEBUG=y 00:14:41.779 18:02:50 -- common/build_config.sh@80 -- # CONFIG_DPDK_COMPRESSDEV=n 00:14:41.779 18:02:50 -- common/build_config.sh@81 -- # CONFIG_CROSS_PREFIX= 00:14:41.779 18:02:50 -- common/build_config.sh@82 -- # CONFIG_URING=n 00:14:41.779 18:02:50 -- common/autotest_common.sh@53 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:14:41.779 18:02:50 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common/applications.sh 00:14:41.779 18:02:50 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:14:41.779 18:02:50 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/common 00:14:41.779 18:02:50 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:14:41.779 18:02:50 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:41.779 18:02:50 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app 00:14:41.779 18:02:50 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:41.779 18:02:50 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:14:41.779 18:02:50 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:14:41.779 18:02:50 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:14:41.779 18:02:50 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:14:41.779 18:02:50 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:14:41.779 18:02:50 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:14:41.779 18:02:50 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/include/spdk/config.h ]] 00:14:41.779 18:02:50 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:14:41.779 #define SPDK_CONFIG_H 00:14:41.779 #define SPDK_CONFIG_APPS 1 00:14:41.779 #define SPDK_CONFIG_ARCH native 00:14:41.779 #undef SPDK_CONFIG_ASAN 00:14:41.779 #undef SPDK_CONFIG_AVAHI 00:14:41.779 #undef SPDK_CONFIG_CET 00:14:41.779 #define SPDK_CONFIG_COVERAGE 1 00:14:41.779 #define SPDK_CONFIG_CROSS_PREFIX 00:14:41.779 #undef SPDK_CONFIG_CRYPTO 00:14:41.779 #undef SPDK_CONFIG_CRYPTO_MLX5 00:14:41.779 #undef SPDK_CONFIG_CUSTOMOCF 00:14:41.779 #undef SPDK_CONFIG_DAOS 00:14:41.779 #define SPDK_CONFIG_DAOS_DIR 00:14:41.779 #define SPDK_CONFIG_DEBUG 1 00:14:41.779 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:14:41.779 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build 00:14:41.779 #define SPDK_CONFIG_DPDK_INC_DIR 00:14:41.779 #define SPDK_CONFIG_DPDK_LIB_DIR 00:14:41.779 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:14:41.779 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-phy-autotest/spdk/lib/env_dpdk 00:14:41.779 #define SPDK_CONFIG_EXAMPLES 1 00:14:41.779 #undef SPDK_CONFIG_FC 00:14:41.779 #define SPDK_CONFIG_FC_PATH 00:14:41.779 #define SPDK_CONFIG_FIO_PLUGIN 1 00:14:41.779 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:14:41.779 #undef SPDK_CONFIG_FUSE 00:14:41.779 #undef SPDK_CONFIG_FUZZER 00:14:41.779 #define SPDK_CONFIG_FUZZER_LIB 00:14:41.779 #undef SPDK_CONFIG_GOLANG 00:14:41.779 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:14:41.779 #define SPDK_CONFIG_HAVE_EVP_MAC 1 00:14:41.779 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:14:41.779 #undef SPDK_CONFIG_HAVE_KEYUTILS 00:14:41.779 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:14:41.779 #undef SPDK_CONFIG_HAVE_LIBBSD 00:14:41.779 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:14:41.779 #define SPDK_CONFIG_IDXD 1 00:14:41.779 #undef SPDK_CONFIG_IDXD_KERNEL 00:14:41.779 #undef SPDK_CONFIG_IPSEC_MB 00:14:41.779 #define SPDK_CONFIG_IPSEC_MB_DIR 00:14:41.779 #define SPDK_CONFIG_ISAL 1 00:14:41.779 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:14:41.779 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:14:41.779 #define SPDK_CONFIG_LIBDIR 00:14:41.779 #undef SPDK_CONFIG_LTO 00:14:41.779 #define SPDK_CONFIG_MAX_LCORES 00:14:41.779 #define SPDK_CONFIG_NVME_CUSE 1 00:14:41.779 #undef SPDK_CONFIG_OCF 00:14:41.779 #define SPDK_CONFIG_OCF_PATH 00:14:41.779 #define SPDK_CONFIG_OPENSSL_PATH 00:14:41.779 #undef SPDK_CONFIG_PGO_CAPTURE 00:14:41.779 #define SPDK_CONFIG_PGO_DIR 00:14:41.779 #undef SPDK_CONFIG_PGO_USE 00:14:41.779 #define SPDK_CONFIG_PREFIX /usr/local 00:14:41.779 #undef SPDK_CONFIG_RAID5F 00:14:41.779 #undef SPDK_CONFIG_RBD 00:14:41.780 #define SPDK_CONFIG_RDMA 1 00:14:41.780 #define SPDK_CONFIG_RDMA_PROV verbs 00:14:41.780 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:14:41.780 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:14:41.780 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:14:41.780 #define SPDK_CONFIG_SHARED 1 00:14:41.780 #undef SPDK_CONFIG_SMA 00:14:41.780 #define SPDK_CONFIG_TESTS 1 00:14:41.780 #undef SPDK_CONFIG_TSAN 00:14:41.780 #define SPDK_CONFIG_UBLK 1 00:14:41.780 #define SPDK_CONFIG_UBSAN 1 00:14:41.780 #undef SPDK_CONFIG_UNIT_TESTS 00:14:41.780 #undef SPDK_CONFIG_URING 00:14:41.780 #define SPDK_CONFIG_URING_PATH 00:14:41.780 #undef SPDK_CONFIG_URING_ZNS 00:14:41.780 #undef SPDK_CONFIG_USDT 00:14:41.780 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:14:41.780 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:14:41.780 #undef SPDK_CONFIG_VFIO_USER 00:14:41.780 #define SPDK_CONFIG_VFIO_USER_DIR 00:14:41.780 #define SPDK_CONFIG_VHOST 1 00:14:41.780 #define SPDK_CONFIG_VIRTIO 1 00:14:41.780 #undef SPDK_CONFIG_VTUNE 00:14:41.780 #define SPDK_CONFIG_VTUNE_DIR 00:14:41.780 #define SPDK_CONFIG_WERROR 1 00:14:41.780 #define SPDK_CONFIG_WPDK_DIR 00:14:41.780 #undef SPDK_CONFIG_XNVME 00:14:41.780 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:14:41.780 18:02:50 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:14:41.780 18:02:50 -- common/autotest_common.sh@54 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:41.780 18:02:50 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:41.780 18:02:50 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:41.780 18:02:50 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:41.780 18:02:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.780 18:02:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.780 18:02:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.780 18:02:50 -- paths/export.sh@5 -- # export PATH 00:14:41.780 18:02:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:41.780 18:02:50 -- common/autotest_common.sh@55 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:14:41.780 18:02:50 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/common 00:14:41.780 18:02:50 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:14:41.780 18:02:50 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm 00:14:41.780 18:02:50 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/../../../ 00:14:41.780 18:02:50 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-phy-autotest/spdk 00:14:41.780 18:02:50 -- pm/common@67 -- # TEST_TAG=N/A 00:14:41.780 18:02:50 -- pm/common@68 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/.run_test_name 00:14:41.780 18:02:50 -- pm/common@70 -- # PM_OUTPUTDIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:14:41.780 18:02:50 -- pm/common@71 -- # uname -s 00:14:41.780 18:02:50 -- pm/common@71 -- # PM_OS=Linux 00:14:41.780 18:02:50 -- pm/common@73 -- # MONITOR_RESOURCES=(collect-cpu-load collect-vmstat) 00:14:41.780 18:02:50 -- pm/common@74 -- # [[ Linux == FreeBSD ]] 00:14:41.780 18:02:50 -- pm/common@76 -- # [[ Linux == Linux ]] 00:14:41.780 18:02:50 -- pm/common@76 -- # [[ ............................... != QEMU ]] 00:14:41.780 18:02:50 -- pm/common@76 -- # [[ ! -e /.dockerenv ]] 00:14:41.780 18:02:50 -- pm/common@79 -- # MONITOR_RESOURCES+=(collect-cpu-temp) 00:14:41.780 18:02:50 -- pm/common@80 -- # MONITOR_RESOURCES+=(collect-bmc-pm) 00:14:41.780 18:02:50 -- pm/common@83 -- # MONITOR_RESOURCES_PIDS=() 00:14:41.780 18:02:50 -- pm/common@83 -- # declare -A MONITOR_RESOURCES_PIDS 00:14:41.780 18:02:50 -- pm/common@85 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power 00:14:41.780 18:02:50 -- common/autotest_common.sh@57 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@58 -- # export RUN_NIGHTLY 00:14:41.780 18:02:50 -- common/autotest_common.sh@61 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@62 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:14:41.780 18:02:50 -- common/autotest_common.sh@63 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@64 -- # export SPDK_RUN_VALGRIND 00:14:41.780 18:02:50 -- common/autotest_common.sh@65 -- # : 1 00:14:41.780 18:02:50 -- common/autotest_common.sh@66 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:14:41.780 18:02:50 -- common/autotest_common.sh@67 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@68 -- # export SPDK_TEST_UNITTEST 00:14:41.780 18:02:50 -- common/autotest_common.sh@69 -- # : 00:14:41.780 18:02:50 -- common/autotest_common.sh@70 -- # export SPDK_TEST_AUTOBUILD 00:14:41.780 18:02:50 -- common/autotest_common.sh@71 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@72 -- # export SPDK_TEST_RELEASE_BUILD 00:14:41.780 18:02:50 -- common/autotest_common.sh@73 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@74 -- # export SPDK_TEST_ISAL 00:14:41.780 18:02:50 -- common/autotest_common.sh@75 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@76 -- # export SPDK_TEST_ISCSI 00:14:41.780 18:02:50 -- common/autotest_common.sh@77 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@78 -- # export SPDK_TEST_ISCSI_INITIATOR 00:14:41.780 18:02:50 -- common/autotest_common.sh@79 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@80 -- # export SPDK_TEST_NVME 00:14:41.780 18:02:50 -- common/autotest_common.sh@81 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@82 -- # export SPDK_TEST_NVME_PMR 00:14:41.780 18:02:50 -- common/autotest_common.sh@83 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@84 -- # export SPDK_TEST_NVME_BP 00:14:41.780 18:02:50 -- common/autotest_common.sh@85 -- # : 1 00:14:41.780 18:02:50 -- common/autotest_common.sh@86 -- # export SPDK_TEST_NVME_CLI 00:14:41.780 18:02:50 -- common/autotest_common.sh@87 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@88 -- # export SPDK_TEST_NVME_CUSE 00:14:41.780 18:02:50 -- common/autotest_common.sh@89 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@90 -- # export SPDK_TEST_NVME_FDP 00:14:41.780 18:02:50 -- common/autotest_common.sh@91 -- # : 1 00:14:41.780 18:02:50 -- common/autotest_common.sh@92 -- # export SPDK_TEST_NVMF 00:14:41.780 18:02:50 -- common/autotest_common.sh@93 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@94 -- # export SPDK_TEST_VFIOUSER 00:14:41.780 18:02:50 -- common/autotest_common.sh@95 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@96 -- # export SPDK_TEST_VFIOUSER_QEMU 00:14:41.780 18:02:50 -- common/autotest_common.sh@97 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@98 -- # export SPDK_TEST_FUZZER 00:14:41.780 18:02:50 -- common/autotest_common.sh@99 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@100 -- # export SPDK_TEST_FUZZER_SHORT 00:14:41.780 18:02:50 -- common/autotest_common.sh@101 -- # : rdma 00:14:41.780 18:02:50 -- common/autotest_common.sh@102 -- # export SPDK_TEST_NVMF_TRANSPORT 00:14:41.780 18:02:50 -- common/autotest_common.sh@103 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@104 -- # export SPDK_TEST_RBD 00:14:41.780 18:02:50 -- common/autotest_common.sh@105 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@106 -- # export SPDK_TEST_VHOST 00:14:41.780 18:02:50 -- common/autotest_common.sh@107 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@108 -- # export SPDK_TEST_BLOCKDEV 00:14:41.780 18:02:50 -- common/autotest_common.sh@109 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@110 -- # export SPDK_TEST_IOAT 00:14:41.780 18:02:50 -- common/autotest_common.sh@111 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@112 -- # export SPDK_TEST_BLOBFS 00:14:41.780 18:02:50 -- common/autotest_common.sh@113 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@114 -- # export SPDK_TEST_VHOST_INIT 00:14:41.780 18:02:50 -- common/autotest_common.sh@115 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@116 -- # export SPDK_TEST_LVOL 00:14:41.780 18:02:50 -- common/autotest_common.sh@117 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@118 -- # export SPDK_TEST_VBDEV_COMPRESS 00:14:41.780 18:02:50 -- common/autotest_common.sh@119 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@120 -- # export SPDK_RUN_ASAN 00:14:41.780 18:02:50 -- common/autotest_common.sh@121 -- # : 1 00:14:41.780 18:02:50 -- common/autotest_common.sh@122 -- # export SPDK_RUN_UBSAN 00:14:41.780 18:02:50 -- common/autotest_common.sh@123 -- # : 00:14:41.780 18:02:50 -- common/autotest_common.sh@124 -- # export SPDK_RUN_EXTERNAL_DPDK 00:14:41.780 18:02:50 -- common/autotest_common.sh@125 -- # : 0 00:14:41.780 18:02:50 -- common/autotest_common.sh@126 -- # export SPDK_RUN_NON_ROOT 00:14:41.781 18:02:50 -- common/autotest_common.sh@127 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@128 -- # export SPDK_TEST_CRYPTO 00:14:41.781 18:02:50 -- common/autotest_common.sh@129 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@130 -- # export SPDK_TEST_FTL 00:14:41.781 18:02:50 -- common/autotest_common.sh@131 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@132 -- # export SPDK_TEST_OCF 00:14:41.781 18:02:50 -- common/autotest_common.sh@133 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@134 -- # export SPDK_TEST_VMD 00:14:41.781 18:02:50 -- common/autotest_common.sh@135 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@136 -- # export SPDK_TEST_OPAL 00:14:41.781 18:02:50 -- common/autotest_common.sh@137 -- # : 00:14:41.781 18:02:50 -- common/autotest_common.sh@138 -- # export SPDK_TEST_NATIVE_DPDK 00:14:41.781 18:02:50 -- common/autotest_common.sh@139 -- # : true 00:14:41.781 18:02:50 -- common/autotest_common.sh@140 -- # export SPDK_AUTOTEST_X 00:14:41.781 18:02:50 -- common/autotest_common.sh@141 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@142 -- # export SPDK_TEST_RAID5 00:14:41.781 18:02:50 -- common/autotest_common.sh@143 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@144 -- # export SPDK_TEST_URING 00:14:41.781 18:02:50 -- common/autotest_common.sh@145 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@146 -- # export SPDK_TEST_USDT 00:14:41.781 18:02:50 -- common/autotest_common.sh@147 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@148 -- # export SPDK_TEST_USE_IGB_UIO 00:14:41.781 18:02:50 -- common/autotest_common.sh@149 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@150 -- # export SPDK_TEST_SCHEDULER 00:14:41.781 18:02:50 -- common/autotest_common.sh@151 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@152 -- # export SPDK_TEST_SCANBUILD 00:14:41.781 18:02:50 -- common/autotest_common.sh@153 -- # : mlx5 00:14:41.781 18:02:50 -- common/autotest_common.sh@154 -- # export SPDK_TEST_NVMF_NICS 00:14:41.781 18:02:50 -- common/autotest_common.sh@155 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@156 -- # export SPDK_TEST_SMA 00:14:41.781 18:02:50 -- common/autotest_common.sh@157 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@158 -- # export SPDK_TEST_DAOS 00:14:41.781 18:02:50 -- common/autotest_common.sh@159 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@160 -- # export SPDK_TEST_XNVME 00:14:41.781 18:02:50 -- common/autotest_common.sh@161 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@162 -- # export SPDK_TEST_ACCEL_DSA 00:14:41.781 18:02:50 -- common/autotest_common.sh@163 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@164 -- # export SPDK_TEST_ACCEL_IAA 00:14:41.781 18:02:50 -- common/autotest_common.sh@166 -- # : 00:14:41.781 18:02:50 -- common/autotest_common.sh@167 -- # export SPDK_TEST_FUZZER_TARGET 00:14:41.781 18:02:50 -- common/autotest_common.sh@168 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@169 -- # export SPDK_TEST_NVMF_MDNS 00:14:41.781 18:02:50 -- common/autotest_common.sh@170 -- # : 0 00:14:41.781 18:02:50 -- common/autotest_common.sh@171 -- # export SPDK_JSONRPC_GO_CLIENT 00:14:41.781 18:02:50 -- common/autotest_common.sh@174 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@174 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@175 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@175 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@176 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@176 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@177 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@177 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:14:41.781 18:02:50 -- common/autotest_common.sh@180 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@180 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@184 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:14:41.781 18:02:50 -- common/autotest_common.sh@184 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-phy-autotest/spdk/python 00:14:41.781 18:02:50 -- common/autotest_common.sh@188 -- # export PYTHONDONTWRITEBYTECODE=1 00:14:41.781 18:02:50 -- common/autotest_common.sh@188 -- # PYTHONDONTWRITEBYTECODE=1 00:14:41.781 18:02:50 -- common/autotest_common.sh@192 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:41.781 18:02:50 -- common/autotest_common.sh@192 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:14:41.781 18:02:50 -- common/autotest_common.sh@193 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:41.781 18:02:50 -- common/autotest_common.sh@193 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:14:41.781 18:02:50 -- common/autotest_common.sh@197 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:14:41.781 18:02:50 -- common/autotest_common.sh@198 -- # rm -rf /var/tmp/asan_suppression_file 00:14:41.781 18:02:50 -- common/autotest_common.sh@199 -- # cat 00:14:41.781 18:02:50 -- common/autotest_common.sh@235 -- # echo leak:libfuse3.so 00:14:41.781 18:02:50 -- common/autotest_common.sh@237 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:41.781 18:02:50 -- common/autotest_common.sh@237 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:14:41.781 18:02:50 -- common/autotest_common.sh@239 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:41.781 18:02:50 -- common/autotest_common.sh@239 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:14:41.781 18:02:50 -- common/autotest_common.sh@241 -- # '[' -z /var/spdk/dependencies ']' 00:14:41.781 18:02:50 -- common/autotest_common.sh@244 -- # export DEPENDENCY_DIR 00:14:41.781 18:02:50 -- common/autotest_common.sh@248 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:41.781 18:02:50 -- common/autotest_common.sh@248 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin 00:14:41.781 18:02:50 -- common/autotest_common.sh@249 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:41.781 18:02:50 -- common/autotest_common.sh@249 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples 00:14:41.781 18:02:50 -- common/autotest_common.sh@252 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:41.781 18:02:50 -- common/autotest_common.sh@252 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:14:41.781 18:02:50 -- common/autotest_common.sh@253 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:41.781 18:02:50 -- common/autotest_common.sh@253 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:14:41.781 18:02:50 -- common/autotest_common.sh@255 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:14:41.781 18:02:50 -- common/autotest_common.sh@255 -- # AR_TOOL=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:14:41.781 18:02:50 -- common/autotest_common.sh@258 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@258 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@261 -- # '[' 0 -eq 0 ']' 00:14:41.781 18:02:50 -- common/autotest_common.sh@262 -- # export valgrind= 00:14:41.781 18:02:50 -- common/autotest_common.sh@262 -- # valgrind= 00:14:41.781 18:02:50 -- common/autotest_common.sh@268 -- # uname -s 00:14:41.781 18:02:50 -- common/autotest_common.sh@268 -- # '[' Linux = Linux ']' 00:14:41.781 18:02:50 -- common/autotest_common.sh@269 -- # HUGEMEM=4096 00:14:41.781 18:02:50 -- common/autotest_common.sh@270 -- # export CLEAR_HUGE=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@270 -- # CLEAR_HUGE=yes 00:14:41.781 18:02:50 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:14:41.781 18:02:50 -- common/autotest_common.sh@271 -- # [[ 0 -eq 1 ]] 00:14:41.781 18:02:50 -- common/autotest_common.sh@278 -- # MAKE=make 00:14:41.781 18:02:50 -- common/autotest_common.sh@279 -- # MAKEFLAGS=-j72 00:14:41.781 18:02:50 -- common/autotest_common.sh@295 -- # export HUGEMEM=4096 00:14:41.781 18:02:50 -- common/autotest_common.sh@295 -- # HUGEMEM=4096 00:14:41.781 18:02:50 -- common/autotest_common.sh@297 -- # NO_HUGE=() 00:14:41.781 18:02:50 -- common/autotest_common.sh@298 -- # TEST_MODE= 00:14:41.781 18:02:50 -- common/autotest_common.sh@299 -- # for i in "$@" 00:14:41.781 18:02:50 -- common/autotest_common.sh@300 -- # case "$i" in 00:14:41.781 18:02:50 -- common/autotest_common.sh@305 -- # TEST_TRANSPORT=rdma 00:14:41.781 18:02:50 -- common/autotest_common.sh@317 -- # [[ -z 960949 ]] 00:14:41.781 18:02:50 -- common/autotest_common.sh@317 -- # kill -0 960949 00:14:41.781 18:02:50 -- common/autotest_common.sh@1676 -- # set_test_storage 2147483648 00:14:41.781 18:02:50 -- common/autotest_common.sh@327 -- # [[ -v testdir ]] 00:14:41.781 18:02:50 -- common/autotest_common.sh@329 -- # local requested_size=2147483648 00:14:41.781 18:02:50 -- common/autotest_common.sh@330 -- # local mount target_dir 00:14:41.781 18:02:50 -- common/autotest_common.sh@332 -- # local -A mounts fss sizes avails uses 00:14:41.781 18:02:50 -- common/autotest_common.sh@333 -- # local source fs size avail mount use 00:14:41.781 18:02:50 -- common/autotest_common.sh@335 -- # local storage_fallback storage_candidates 00:14:41.781 18:02:50 -- common/autotest_common.sh@337 -- # mktemp -udt spdk.XXXXXX 00:14:41.781 18:02:50 -- common/autotest_common.sh@337 -- # storage_fallback=/tmp/spdk.uEUxcU 00:14:41.782 18:02:50 -- common/autotest_common.sh@342 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:14:41.782 18:02:50 -- common/autotest_common.sh@344 -- # [[ -n '' ]] 00:14:41.782 18:02:50 -- common/autotest_common.sh@349 -- # [[ -n '' ]] 00:14:41.782 18:02:50 -- common/autotest_common.sh@354 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target /tmp/spdk.uEUxcU/tests/target /tmp/spdk.uEUxcU 00:14:42.042 18:02:50 -- common/autotest_common.sh@357 -- # requested_size=2214592512 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@326 -- # df -T 00:14:42.042 18:02:50 -- common/autotest_common.sh@326 -- # grep -v Filesystem 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_devtmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=devtmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=67108864 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=67108864 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=0 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/pmem0 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=ext2 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=988676096 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=5284429824 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=4295753728 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=spdk_root 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=overlay 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=56390971392 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=61742698496 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=5351727104 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=/dev/sda1 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=xfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=221821267968 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=239938535424 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=18117267456 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=30864343040 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=30871347200 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=7004160 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=12325724160 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=12348542976 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=22818816 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=30871035904 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=30871351296 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=315392 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # mounts["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@360 -- # fss["$mount"]=tmpfs 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # avails["$mount"]=6174265344 00:14:42.042 18:02:50 -- common/autotest_common.sh@361 -- # sizes["$mount"]=6174269440 00:14:42.042 18:02:50 -- common/autotest_common.sh@362 -- # uses["$mount"]=4096 00:14:42.042 18:02:50 -- common/autotest_common.sh@359 -- # read -r source fs size use avail _ mount 00:14:42.042 18:02:50 -- common/autotest_common.sh@365 -- # printf '* Looking for test storage...\n' 00:14:42.042 * Looking for test storage... 00:14:42.042 18:02:50 -- common/autotest_common.sh@367 -- # local target_space new_size 00:14:42.042 18:02:50 -- common/autotest_common.sh@368 -- # for target_dir in "${storage_candidates[@]}" 00:14:42.042 18:02:50 -- common/autotest_common.sh@371 -- # awk '$1 !~ /Filesystem/{print $6}' 00:14:42.042 18:02:50 -- common/autotest_common.sh@371 -- # df /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:42.042 18:02:50 -- common/autotest_common.sh@371 -- # mount=/ 00:14:42.042 18:02:50 -- common/autotest_common.sh@373 -- # target_space=56390971392 00:14:42.042 18:02:51 -- common/autotest_common.sh@374 -- # (( target_space == 0 || target_space < requested_size )) 00:14:42.042 18:02:51 -- common/autotest_common.sh@377 -- # (( target_space >= requested_size )) 00:14:42.042 18:02:51 -- common/autotest_common.sh@379 -- # [[ overlay == tmpfs ]] 00:14:42.042 18:02:51 -- common/autotest_common.sh@379 -- # [[ overlay == ramfs ]] 00:14:42.042 18:02:51 -- common/autotest_common.sh@379 -- # [[ / == / ]] 00:14:42.042 18:02:51 -- common/autotest_common.sh@380 -- # new_size=7566319616 00:14:42.042 18:02:51 -- common/autotest_common.sh@381 -- # (( new_size * 100 / sizes[/] > 95 )) 00:14:42.042 18:02:51 -- common/autotest_common.sh@386 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:42.042 18:02:51 -- common/autotest_common.sh@386 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:42.042 18:02:51 -- common/autotest_common.sh@387 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:42.042 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:42.042 18:02:51 -- common/autotest_common.sh@388 -- # return 0 00:14:42.042 18:02:51 -- common/autotest_common.sh@1678 -- # set -o errtrace 00:14:42.042 18:02:51 -- common/autotest_common.sh@1679 -- # shopt -s extdebug 00:14:42.042 18:02:51 -- common/autotest_common.sh@1680 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:14:42.043 18:02:51 -- common/autotest_common.sh@1682 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:14:42.043 18:02:51 -- common/autotest_common.sh@1683 -- # true 00:14:42.043 18:02:51 -- common/autotest_common.sh@1685 -- # xtrace_fd 00:14:42.043 18:02:51 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:14:42.043 18:02:51 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:14:42.043 18:02:51 -- common/autotest_common.sh@27 -- # exec 00:14:42.043 18:02:51 -- common/autotest_common.sh@29 -- # exec 00:14:42.043 18:02:51 -- common/autotest_common.sh@31 -- # xtrace_restore 00:14:42.043 18:02:51 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:14:42.043 18:02:51 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:14:42.043 18:02:51 -- common/autotest_common.sh@18 -- # set -x 00:14:42.043 18:02:51 -- target/device_removal.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:14:42.043 18:02:51 -- nvmf/common.sh@7 -- # uname -s 00:14:42.043 18:02:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:42.043 18:02:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:42.043 18:02:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:42.043 18:02:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:42.043 18:02:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:42.043 18:02:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:42.043 18:02:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:42.043 18:02:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:42.043 18:02:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:42.043 18:02:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:42.043 18:02:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:14:42.043 18:02:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:14:42.043 18:02:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:42.043 18:02:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:42.043 18:02:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:42.043 18:02:51 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:14:42.043 18:02:51 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:14:42.043 18:02:51 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:42.043 18:02:51 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:42.043 18:02:51 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:42.043 18:02:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.043 18:02:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.043 18:02:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.043 18:02:51 -- paths/export.sh@5 -- # export PATH 00:14:42.043 18:02:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.043 18:02:51 -- nvmf/common.sh@47 -- # : 0 00:14:42.043 18:02:51 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:14:42.043 18:02:51 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:14:42.043 18:02:51 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:14:42.043 18:02:51 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:42.043 18:02:51 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:42.043 18:02:51 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:14:42.043 18:02:51 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:14:42.043 18:02:51 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:14:42.043 18:02:51 -- target/device_removal.sh@13 -- # tgt_core_mask=0x3 00:14:42.043 18:02:51 -- target/device_removal.sh@14 -- # bdevperf_core_mask=0x4 00:14:42.043 18:02:51 -- target/device_removal.sh@15 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:42.043 18:02:51 -- target/device_removal.sh@16 -- # bdevperf_rpc_pid=-1 00:14:42.043 18:02:51 -- target/device_removal.sh@18 -- # nvmftestinit 00:14:42.043 18:02:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:14:42.043 18:02:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:42.043 18:02:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:14:42.043 18:02:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:14:42.043 18:02:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:14:42.043 18:02:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.043 18:02:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:42.043 18:02:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.043 18:02:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:14:42.043 18:02:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:14:42.043 18:02:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:14:42.043 18:02:51 -- common/autotest_common.sh@10 -- # set +x 00:14:48.661 18:02:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:48.661 18:02:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:14:48.661 18:02:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:14:48.661 18:02:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:14:48.661 18:02:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:14:48.661 18:02:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:14:48.661 18:02:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:14:48.661 18:02:57 -- nvmf/common.sh@295 -- # net_devs=() 00:14:48.661 18:02:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:14:48.661 18:02:57 -- nvmf/common.sh@296 -- # e810=() 00:14:48.661 18:02:57 -- nvmf/common.sh@296 -- # local -ga e810 00:14:48.661 18:02:57 -- nvmf/common.sh@297 -- # x722=() 00:14:48.661 18:02:57 -- nvmf/common.sh@297 -- # local -ga x722 00:14:48.661 18:02:57 -- nvmf/common.sh@298 -- # mlx=() 00:14:48.661 18:02:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:14:48.661 18:02:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:48.661 18:02:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:14:48.661 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:14:48.661 18:02:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:48.661 18:02:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:14:48.661 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:14:48.661 18:02:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:14:48.661 18:02:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.661 18:02:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.661 18:02:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:14:48.661 Found net devices under 0000:18:00.0: mlx_0_0 00:14:48.661 18:02:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.661 18:02:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.661 18:02:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:14:48.661 Found net devices under 0000:18:00.1: mlx_0_1 00:14:48.661 18:02:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.661 18:02:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:14:48.661 18:02:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:14:48.661 18:02:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:14:48.661 18:02:57 -- nvmf/common.sh@58 -- # uname 00:14:48.661 18:02:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:14:48.661 18:02:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:14:48.661 18:02:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:14:48.661 18:02:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:14:48.661 18:02:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:14:48.661 18:02:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:14:48.661 18:02:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:14:48.661 18:02:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:14:48.661 18:02:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:14:48.661 18:02:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:14:48.661 18:02:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:14:48.661 18:02:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:48.661 18:02:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:48.661 18:02:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:48.661 18:02:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:48.661 18:02:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:48.661 18:02:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:48.661 18:02:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:48.661 18:02:57 -- nvmf/common.sh@105 -- # continue 2 00:14:48.661 18:02:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.661 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@105 -- # continue 2 00:14:48.662 18:02:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:48.662 18:02:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:48.662 18:02:57 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:14:48.662 18:02:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:14:48.662 12: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:48.662 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:14:48.662 altname enp24s0f0np0 00:14:48.662 altname ens785f0np0 00:14:48.662 inet 192.168.100.8/24 scope global mlx_0_0 00:14:48.662 valid_lft forever preferred_lft forever 00:14:48.662 18:02:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:14:48.662 18:02:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:48.662 18:02:57 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:14:48.662 18:02:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:14:48.662 13: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:14:48.662 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:14:48.662 altname enp24s0f1np1 00:14:48.662 altname ens785f1np1 00:14:48.662 inet 192.168.100.9/24 scope global mlx_0_1 00:14:48.662 valid_lft forever preferred_lft forever 00:14:48.662 18:02:57 -- nvmf/common.sh@411 -- # return 0 00:14:48.662 18:02:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:14:48.662 18:02:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:14:48.662 18:02:57 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:14:48.662 18:02:57 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:14:48.662 18:02:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:48.662 18:02:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:48.662 18:02:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:48.662 18:02:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:48.662 18:02:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:48.662 18:02:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@105 -- # continue 2 00:14:48.662 18:02:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:48.662 18:02:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:48.662 18:02:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@105 -- # continue 2 00:14:48.662 18:02:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:48.662 18:02:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:48.662 18:02:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:14:48.662 18:02:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:48.662 18:02:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:48.662 18:02:57 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:14:48.662 192.168.100.9' 00:14:48.662 18:02:57 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:14:48.662 192.168.100.9' 00:14:48.662 18:02:57 -- nvmf/common.sh@446 -- # head -n 1 00:14:48.662 18:02:57 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:14:48.662 18:02:57 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:14:48.662 192.168.100.9' 00:14:48.662 18:02:57 -- nvmf/common.sh@447 -- # tail -n +2 00:14:48.662 18:02:57 -- nvmf/common.sh@447 -- # head -n 1 00:14:48.662 18:02:57 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:14:48.662 18:02:57 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:14:48.662 18:02:57 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:14:48.662 18:02:57 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:14:48.662 18:02:57 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:14:48.662 18:02:57 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:14:48.662 18:02:57 -- target/device_removal.sh@235 -- # BOND_NAME=bond_nvmf 00:14:48.662 18:02:57 -- target/device_removal.sh@236 -- # BOND_IP=10.11.11.26 00:14:48.662 18:02:57 -- target/device_removal.sh@237 -- # BOND_MASK=24 00:14:48.662 18:02:57 -- target/device_removal.sh@311 -- # run_test nvmf_device_removal_pci_remove_no_srq test_remove_and_rescan --no-srq 00:14:48.662 18:02:57 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:14:48.662 18:02:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:14:48.662 18:02:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.662 ************************************ 00:14:48.662 START TEST nvmf_device_removal_pci_remove_no_srq 00:14:48.662 ************************************ 00:14:48.662 18:02:57 -- common/autotest_common.sh@1121 -- # test_remove_and_rescan --no-srq 00:14:48.662 18:02:57 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:14:48.662 18:02:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:14:48.662 18:02:57 -- common/autotest_common.sh@720 -- # xtrace_disable 00:14:48.662 18:02:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.662 18:02:57 -- nvmf/common.sh@470 -- # nvmfpid=963840 00:14:48.662 18:02:57 -- nvmf/common.sh@471 -- # waitforlisten 963840 00:14:48.662 18:02:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:48.662 18:02:57 -- common/autotest_common.sh@827 -- # '[' -z 963840 ']' 00:14:48.662 18:02:57 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:48.662 18:02:57 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:48.662 18:02:57 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:48.662 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:48.662 18:02:57 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:48.662 18:02:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.662 [2024-04-26 18:02:57.553909] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:14:48.662 [2024-04-26 18:02:57.553971] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:48.662 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.662 [2024-04-26 18:02:57.625513] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:48.662 [2024-04-26 18:02:57.710278] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:48.662 [2024-04-26 18:02:57.710319] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:48.662 [2024-04-26 18:02:57.710328] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:14:48.662 [2024-04-26 18:02:57.710342] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:14:48.662 [2024-04-26 18:02:57.710350] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:48.662 [2024-04-26 18:02:57.710399] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:48.662 [2024-04-26 18:02:57.710403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.229 18:02:58 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:49.229 18:02:58 -- common/autotest_common.sh@860 -- # return 0 00:14:49.229 18:02:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:14:49.229 18:02:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:14:49.229 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.229 18:02:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:49.229 18:02:58 -- target/device_removal.sh@130 -- # create_subsystem_and_connect --no-srq 00:14:49.229 18:02:58 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:14:49.229 18:02:58 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:14:49.229 18:02:58 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 --no-srq 00:14:49.229 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.229 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.488 [2024-04-26 18:02:58.438506] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1baef40/0x1bb3430) succeed. 00:14:49.488 [2024-04-26 18:02:58.447509] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bb0440/0x1bf4ac0) succeed. 00:14:49.488 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.488 18:02:58 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:14:49.488 18:02:58 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:14:49.488 18:02:58 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:14:49.488 18:02:58 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:14:49.488 18:02:58 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:14:49.488 18:02:58 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:14:49.488 18:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:49.488 18:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:49.488 18:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:14:49.488 18:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:14:49.488 18:02:58 -- nvmf/common.sh@105 -- # continue 2 00:14:49.488 18:02:58 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:14:49.488 18:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:49.488 18:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:14:49.488 18:02:58 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:14:49.488 18:02:58 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:14:49.488 18:02:58 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:14:49.488 18:02:58 -- nvmf/common.sh@105 -- # continue 2 00:14:49.488 18:02:58 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:14:49.488 18:02:58 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@25 -- # local -a dev_name 00:14:49.488 18:02:58 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:14:49.488 18:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:49.488 18:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:49.488 18:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:49.488 18:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:49.488 18:02:58 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:14:49.488 18:02:58 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:14:49.488 18:02:58 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:14:49.488 18:02:58 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:14:49.488 18:02:58 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:14:49.488 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.488 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.488 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.488 18:02:58 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:14:49.488 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.488 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.488 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.488 18:02:58 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:14:49.488 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.488 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.488 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:14:49.489 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.489 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.489 [2024-04-26 18:02:58.580287] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:14:49.489 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@41 -- # return 0 00:14:49.489 18:02:58 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:14:49.489 18:02:58 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:14:49.489 18:02:58 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@25 -- # local -a dev_name 00:14:49.489 18:02:58 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:14:49.489 18:02:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:49.489 18:02:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:49.489 18:02:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:49.489 18:02:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:49.489 18:02:58 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:14:49.489 18:02:58 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:14:49.489 18:02:58 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:14:49.489 18:02:58 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:14:49.489 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.489 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.489 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:14:49.489 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.489 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.489 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:14:49.489 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.489 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.489 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:14:49.489 18:02:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:49.489 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:49.489 [2024-04-26 18:02:58.667903] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:14:49.489 18:02:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:49.489 18:02:58 -- target/device_removal.sh@41 -- # return 0 00:14:49.489 18:02:58 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@53 -- # return 0 00:14:49.489 18:02:58 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:14:49.489 18:02:58 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:14:49.489 18:02:58 -- target/device_removal.sh@87 -- # local dev_names 00:14:49.489 18:02:58 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:14:49.747 18:02:58 -- target/device_removal.sh@91 -- # bdevperf_pid=964055 00:14:49.747 18:02:58 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:49.747 18:02:58 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:14:49.747 18:02:58 -- target/device_removal.sh@94 -- # waitforlisten 964055 /var/tmp/bdevperf.sock 00:14:49.747 18:02:58 -- common/autotest_common.sh@827 -- # '[' -z 964055 ']' 00:14:49.747 18:02:58 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:49.747 18:02:58 -- common/autotest_common.sh@832 -- # local max_retries=100 00:14:49.747 18:02:58 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:49.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:49.747 18:02:58 -- common/autotest_common.sh@836 -- # xtrace_disable 00:14:49.747 18:02:58 -- common/autotest_common.sh@10 -- # set +x 00:14:50.685 18:02:59 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:14:50.685 18:02:59 -- common/autotest_common.sh@860 -- # return 0 00:14:50.685 18:02:59 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:14:50.685 18:02:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:50.685 18:02:59 -- common/autotest_common.sh@10 -- # set +x 00:14:50.685 18:02:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:50.685 18:02:59 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:14:50.685 18:02:59 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:14:50.685 18:02:59 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:14:50.685 18:02:59 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:14:50.685 18:02:59 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:14:50.685 18:02:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:50.685 18:02:59 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:14:50.685 18:02:59 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:14:50.685 18:02:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:50.685 18:02:59 -- common/autotest_common.sh@10 -- # set +x 00:14:50.685 Nvme_mlx_0_0n1 00:14:50.685 18:02:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:50.685 18:02:59 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:14:50.685 18:02:59 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:14:50.685 18:02:59 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:14:50.685 18:02:59 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:14:50.685 18:02:59 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:14:50.685 18:02:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:14:50.685 18:02:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:50.685 18:02:59 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:14:50.685 18:02:59 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:14:50.685 18:02:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:50.685 18:02:59 -- common/autotest_common.sh@10 -- # set +x 00:14:50.686 Nvme_mlx_0_1n1 00:14:50.686 18:02:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:50.686 18:02:59 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=964247 00:14:50.686 18:02:59 -- target/device_removal.sh@112 -- # sleep 5 00:14:50.686 18:02:59 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:14:55.960 18:03:04 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:14:55.960 18:03:04 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:55.960 18:03:04 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:14:55.960 18:03:04 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:14:55.960 18:03:04 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:14:55.960 18:03:04 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:14:55.960 18:03:04 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:14:55.960 18:03:04 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:14:55.960 18:03:04 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:14:55.960 18:03:04 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:14:55.960 18:03:04 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:55.960 18:03:04 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:14:55.960 18:03:04 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:14:55.960 18:03:04 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:14:55.960 18:03:04 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:14:55.960 18:03:04 -- target/device_removal.sh@77 -- # grep mlx5_0 00:14:55.960 18:03:04 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:14:55.960 18:03:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:14:55.960 18:03:04 -- common/autotest_common.sh@10 -- # set +x 00:14:55.960 18:03:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:14:55.960 mlx5_0 00:14:55.960 18:03:04 -- target/device_removal.sh@78 -- # return 0 00:14:55.960 18:03:04 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@67 -- # echo 1 00:14:55.960 18:03:04 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:14:55.960 18:03:04 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:14:55.960 [2024-04-26 18:03:04.933497] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:14:55.960 [2024-04-26 18:03:04.933624] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:14:55.960 [2024-04-26 18:03:04.935167] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:14:55.961 [2024-04-26 18:03:04.935185] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 63 00:14:55.961 [2024-04-26 18:03:04.935204] rdma.c: 632:nvmf_rdma_dump_qpair_contents: *ERROR*: Dumping contents of queue pair (QID 1) 00:14:55.961 [2024-04-26 18:03:04.935213] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935221] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935228] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935236] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935244] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935253] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935261] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935268] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935275] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935282] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935289] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935297] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935305] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935312] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935319] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935326] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935333] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935345] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935353] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935360] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935367] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935374] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935382] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935389] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935396] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935403] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935410] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935417] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935425] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935433] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935444] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935452] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935459] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935466] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935473] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935480] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935487] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935494] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935502] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935509] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935518] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935525] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935533] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935540] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935547] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935554] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935562] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935569] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935576] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935583] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935590] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935597] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935604] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935612] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935620] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935627] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935635] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935642] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935649] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935656] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935663] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935670] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935678] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935686] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935693] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935700] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935707] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935714] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935724] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935731] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935739] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935746] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935754] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935761] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935768] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935775] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935782] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935789] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935797] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935804] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935811] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935818] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935827] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935834] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935841] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935848] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935856] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935863] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935870] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935877] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935885] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935892] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935899] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935906] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935915] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935923] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935930] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935937] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935944] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935951] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935958] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.935965] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.935972] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935979] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.935987] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.935994] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.936003] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.936010] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.936017] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.936024] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.936033] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.961 [2024-04-26 18:03:04.936041] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.961 [2024-04-26 18:03:04.936049] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.961 [2024-04-26 18:03:04.936056] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.961 [2024-04-26 18:03:04.936063] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 1 00:14:55.962 [2024-04-26 18:03:04.936070] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 2 00:14:55.962 [2024-04-26 18:03:04.936077] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.962 [2024-04-26 18:03:04.936084] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.962 [2024-04-26 18:03:04.936091] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.962 [2024-04-26 18:03:04.936099] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.962 [2024-04-26 18:03:04.936106] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.962 [2024-04-26 18:03:04.936113] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.962 [2024-04-26 18:03:04.936120] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.962 [2024-04-26 18:03:04.936127] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:14:55.962 [2024-04-26 18:03:04.936135] rdma.c: 618:nvmf_rdma_dump_request: *ERROR*: Request Data From Pool: 0 00:14:55.962 [2024-04-26 18:03:04.936142] rdma.c: 620:nvmf_rdma_dump_request: *ERROR*: Request opcode: 1 00:15:02.529 18:03:10 -- target/device_removal.sh@147 -- # seq 1 10 00:15:02.529 18:03:10 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:15:02.529 18:03:10 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:15:02.529 18:03:10 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:15:02.529 18:03:10 -- target/device_removal.sh@77 -- # grep mlx5_0 00:15:02.529 18:03:10 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:02.529 18:03:10 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:02.529 18:03:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:02.529 18:03:10 -- common/autotest_common.sh@10 -- # set +x 00:15:02.529 18:03:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:02.529 18:03:10 -- target/device_removal.sh@78 -- # return 1 00:15:02.529 18:03:10 -- target/device_removal.sh@149 -- # break 00:15:02.529 18:03:10 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:02.529 18:03:10 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:02.529 18:03:10 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:02.529 18:03:10 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:02.529 18:03:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:02.529 18:03:10 -- common/autotest_common.sh@10 -- # set +x 00:15:02.529 18:03:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:02.529 18:03:10 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:15:02.529 18:03:10 -- target/device_removal.sh@160 -- # rescan_pci 00:15:02.529 18:03:10 -- target/device_removal.sh@57 -- # echo 1 00:15:02.529 [2024-04-26 18:03:11.706004] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1dcb6e0, err 11. Skip rescan. 00:15:02.788 18:03:11 -- target/device_removal.sh@162 -- # seq 1 10 00:15:02.788 18:03:11 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:15:02.788 18:03:11 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:15:02.788 18:03:11 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:15:02.788 18:03:11 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:15:02.788 18:03:11 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:15:02.788 18:03:11 -- target/device_removal.sh@171 -- # break 00:15:02.788 18:03:11 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:15:02.788 18:03:11 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:15:03.047 [2024-04-26 18:03:12.080354] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1f2dee0/0x1bb3430) succeed. 00:15:03.047 [2024-04-26 18:03:12.080422] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:15:06.348 18:03:15 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:15:06.348 18:03:15 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:06.348 18:03:15 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:15:06.348 18:03:15 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:15:06.348 18:03:15 -- target/device_removal.sh@186 -- # seq 1 10 00:15:06.348 18:03:15 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:15:06.348 18:03:15 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:06.348 18:03:15 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:06.348 18:03:15 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:06.348 18:03:15 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:06.348 18:03:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:06.348 18:03:15 -- common/autotest_common.sh@10 -- # set +x 00:15:06.348 [2024-04-26 18:03:15.080016] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:15:06.348 [2024-04-26 18:03:15.080048] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:15:06.348 [2024-04-26 18:03:15.080065] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:06.348 [2024-04-26 18:03:15.080084] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:06.348 18:03:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:06.348 18:03:15 -- target/device_removal.sh@187 -- # ib_count=2 00:15:06.348 18:03:15 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:15:06.348 18:03:15 -- target/device_removal.sh@189 -- # break 00:15:06.348 18:03:15 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:15:06.348 18:03:15 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:15:06.348 18:03:15 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:15:06.348 18:03:15 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:15:06.348 18:03:15 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:15:06.348 18:03:15 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:06.348 18:03:15 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:06.348 18:03:15 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:15:06.348 18:03:15 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:06.348 18:03:15 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:15:06.348 18:03:15 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:15:06.348 18:03:15 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:15:06.348 18:03:15 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:15:06.348 18:03:15 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:06.348 18:03:15 -- target/device_removal.sh@77 -- # grep mlx5_1 00:15:06.348 18:03:15 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:06.348 18:03:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:06.348 18:03:15 -- common/autotest_common.sh@10 -- # set +x 00:15:06.348 18:03:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:06.348 mlx5_1 00:15:06.349 18:03:15 -- target/device_removal.sh@78 -- # return 0 00:15:06.349 18:03:15 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:15:06.349 18:03:15 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:15:06.349 18:03:15 -- target/device_removal.sh@67 -- # echo 1 00:15:06.349 18:03:15 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:15:06.349 18:03:15 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:15:06.349 18:03:15 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:15:06.349 [2024-04-26 18:03:15.254852] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:15:06.349 [2024-04-26 18:03:15.254931] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:06.349 [2024-04-26 18:03:15.262868] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:15:11.645 18:03:20 -- target/device_removal.sh@147 -- # seq 1 10 00:15:11.645 18:03:20 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:15:11.645 18:03:20 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:15:11.645 18:03:20 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:15:11.645 18:03:20 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:15:11.645 18:03:20 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:15:11.645 18:03:20 -- target/device_removal.sh@77 -- # grep mlx5_1 00:15:11.645 18:03:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:11.645 18:03:20 -- common/autotest_common.sh@10 -- # set +x 00:15:11.904 18:03:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:11.904 18:03:20 -- target/device_removal.sh@78 -- # return 1 00:15:11.904 18:03:20 -- target/device_removal.sh@149 -- # break 00:15:11.904 18:03:20 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:11.904 18:03:20 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:11.904 18:03:20 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:11.904 18:03:20 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:11.904 18:03:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:11.904 18:03:20 -- common/autotest_common.sh@10 -- # set +x 00:15:11.904 18:03:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:11.904 18:03:20 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:15:11.904 18:03:20 -- target/device_removal.sh@160 -- # rescan_pci 00:15:11.904 18:03:20 -- target/device_removal.sh@57 -- # echo 1 00:15:12.843 [2024-04-26 18:03:21.843138] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1dbb8c0, err 11. Skip rescan. 00:15:12.843 18:03:21 -- target/device_removal.sh@162 -- # seq 1 10 00:15:12.843 18:03:21 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:15:12.843 18:03:21 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:15:12.843 18:03:21 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:15:12.843 18:03:21 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:15:12.843 18:03:21 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:15:12.843 18:03:21 -- target/device_removal.sh@171 -- # break 00:15:12.843 18:03:21 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:15:12.843 18:03:21 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:15:13.102 [2024-04-26 18:03:22.200550] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bb2070/0x1bf4ac0) succeed. 00:15:13.102 [2024-04-26 18:03:22.200640] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:15:16.391 18:03:25 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:15:16.391 18:03:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:15:16.391 18:03:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:15:16.391 18:03:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:15:16.391 18:03:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:15:16.391 18:03:25 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:15:16.391 18:03:25 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:15:16.391 18:03:25 -- target/device_removal.sh@186 -- # seq 1 10 00:15:16.391 18:03:25 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:15:16.391 18:03:25 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:15:16.391 18:03:25 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:15:16.391 18:03:25 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:15:16.391 [2024-04-26 18:03:25.284912] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:15:16.391 [2024-04-26 18:03:25.284951] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:15:16.391 [2024-04-26 18:03:25.284972] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:16.391 [2024-04-26 18:03:25.284990] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:15:16.391 18:03:25 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:15:16.391 18:03:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:15:16.391 18:03:25 -- common/autotest_common.sh@10 -- # set +x 00:15:16.391 18:03:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:15:16.391 18:03:25 -- target/device_removal.sh@187 -- # ib_count=2 00:15:16.391 18:03:25 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:15:16.391 18:03:25 -- target/device_removal.sh@189 -- # break 00:15:16.391 18:03:25 -- target/device_removal.sh@200 -- # stop_bdevperf 00:15:16.391 18:03:25 -- target/device_removal.sh@116 -- # wait 964247 00:16:24.152 0 00:16:24.152 18:04:30 -- target/device_removal.sh@118 -- # killprocess 964055 00:16:24.152 18:04:30 -- common/autotest_common.sh@946 -- # '[' -z 964055 ']' 00:16:24.152 18:04:30 -- common/autotest_common.sh@950 -- # kill -0 964055 00:16:24.152 18:04:30 -- common/autotest_common.sh@951 -- # uname 00:16:24.152 18:04:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:16:24.152 18:04:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 964055 00:16:24.152 18:04:30 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:16:24.152 18:04:30 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:16:24.152 18:04:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 964055' 00:16:24.152 killing process with pid 964055 00:16:24.152 18:04:30 -- common/autotest_common.sh@965 -- # kill 964055 00:16:24.152 18:04:30 -- common/autotest_common.sh@970 -- # wait 964055 00:16:24.152 18:04:30 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:16:24.152 18:04:30 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:24.152 [2024-04-26 18:02:58.725870] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:16:24.152 [2024-04-26 18:02:58.725937] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid964055 ] 00:16:24.152 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.152 [2024-04-26 18:02:58.793468] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:24.152 [2024-04-26 18:02:58.882785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:24.152 Running I/O for 90 seconds... 00:16:24.152 [2024-04-26 18:03:04.934836] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:24.152 [2024-04-26 18:03:04.934876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.152 [2024-04-26 18:03:04.934890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.152 [2024-04-26 18:03:04.934904] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.152 [2024-04-26 18:03:04.934914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.152 [2024-04-26 18:03:04.934924] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.152 [2024-04-26 18:03:04.934934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.152 [2024-04-26 18:03:04.934945] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.152 [2024-04-26 18:03:04.934955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:16 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.152 [2024-04-26 18:03:04.936507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.152 [2024-04-26 18:03:04.936524] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.152 [2024-04-26 18:03:04.936561] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:24.152 [2024-04-26 18:03:04.944830] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:04.955511] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:04.965865] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:04.976332] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:04.986610] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:04.997250] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.007398] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.017582] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.027746] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.037764] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.047797] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.057860] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.068171] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.078201] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.088227] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.098392] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.108609] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.118767] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.128794] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.138819] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.148972] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.159140] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.169166] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.179484] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.189650] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.199766] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.209805] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.219928] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.230091] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.240207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.250288] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.260417] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.270523] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.280655] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.290775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.300864] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.152 [2024-04-26 18:03:05.310937] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.321090] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.331296] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.341429] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.351634] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.361859] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.372002] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.382167] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.392381] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.402760] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.412959] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.423169] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.433693] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.443819] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.453922] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.464007] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.474244] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.484271] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.494298] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.504406] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.514519] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.524968] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.534995] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.545077] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.555184] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.565244] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.575419] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.585539] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.595565] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.605633] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.615813] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.625945] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.636049] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.646158] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.656281] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.666383] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.676490] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.686546] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.696656] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.706782] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.716856] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.726976] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.737110] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.747230] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.757302] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.767384] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.777544] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.787622] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.798183] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.808254] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.818281] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.828564] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.838767] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.848884] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.859355] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.869577] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.879739] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.890154] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.900222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.910346] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.920475] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.930634] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.153 [2024-04-26 18:03:05.939013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:200552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:200560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:200568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:200576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:200584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:200592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:200600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:200608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:200616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:200624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:200632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x181500 00:16:24.153 [2024-04-26 18:03:05.939254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.153 [2024-04-26 18:03:05.939265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:200640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:200648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:200656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:200664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:200672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:200680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:200688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:200696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x181500 00:16:24.154 [2024-04-26 18:03:05.939423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:200704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:200712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:200720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:200728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:200736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:200744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:200752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:200760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:200768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:200776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:200784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:200792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:200800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:200808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:200816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:200824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:200832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:200840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:200848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:200856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:200864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:200872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:200880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:200888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:200896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:200904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:200912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.939981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:200920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.939990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.940001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:200928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.940010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.940021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:200936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.940032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.154 [2024-04-26 18:03:05.940042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:200944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.154 [2024-04-26 18:03:05.940052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:200952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:200960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:200968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:200976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:200984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:200992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:201000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:201008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:201016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:201024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:201032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:201040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:201048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:201056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:201064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:201072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:201080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:201088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:201096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:201104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:201112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:201120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:201128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:201136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:201144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:201152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:201160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:201168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:201176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:201184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:201192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:201200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:201208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:201216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:201224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:201232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:201240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.155 [2024-04-26 18:03:05.940807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.155 [2024-04-26 18:03:05.940818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:201248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:201256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:201264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:201272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:201280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:201288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:201296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:201304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:201312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.940988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.940999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:201320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:201328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:201336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:201344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:201352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:201360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:201368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:201376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:201384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:201392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:201400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:201408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:201416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:201424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:201432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:201440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:201448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.156 [2024-04-26 18:03:05.941351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:201456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.156 [2024-04-26 18:03:05.941360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:201464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:201472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:201480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:201488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:201496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:201504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:201512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:201520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:201528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:201536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:201544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:201552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.941615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:201560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.157 [2024-04-26 18:03:05.941624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.954627] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:24.157 [2024-04-26 18:03:05.954642] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:24.157 [2024-04-26 18:03:05.954652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:201568 len:8 PRP1 0x0 PRP2 0x0 00:16:24.157 [2024-04-26 18:03:05.954662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:24.157 [2024-04-26 18:03:05.956724] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.157 [2024-04-26 18:03:05.957006] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.157 [2024-04-26 18:03:05.957022] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.157 [2024-04-26 18:03:05.957030] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.157 [2024-04-26 18:03:05.957057] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.157 [2024-04-26 18:03:05.957068] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.157 [2024-04-26 18:03:05.957080] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.157 [2024-04-26 18:03:05.957089] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.157 [2024-04-26 18:03:05.957100] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.157 [2024-04-26 18:03:05.957122] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.157 [2024-04-26 18:03:05.957131] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.157 [2024-04-26 18:03:06.959637] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.157 [2024-04-26 18:03:06.959680] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.157 [2024-04-26 18:03:06.959689] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.157 [2024-04-26 18:03:06.959712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.157 [2024-04-26 18:03:06.959723] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.157 [2024-04-26 18:03:06.960093] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.157 [2024-04-26 18:03:06.960105] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.157 [2024-04-26 18:03:06.960116] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.157 [2024-04-26 18:03:06.960977] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.157 [2024-04-26 18:03:06.960992] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.157 [2024-04-26 18:03:07.963507] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.157 [2024-04-26 18:03:07.963550] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.157 [2024-04-26 18:03:07.963560] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.157 [2024-04-26 18:03:07.963582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.157 [2024-04-26 18:03:07.963593] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.157 [2024-04-26 18:03:07.963606] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.157 [2024-04-26 18:03:07.963616] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.157 [2024-04-26 18:03:07.963627] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.157 [2024-04-26 18:03:07.963653] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.157 [2024-04-26 18:03:07.963664] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.157 [2024-04-26 18:03:09.969321] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.157 [2024-04-26 18:03:09.969366] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.157 [2024-04-26 18:03:09.969395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.157 [2024-04-26 18:03:09.969406] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.157 [2024-04-26 18:03:09.969428] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.157 [2024-04-26 18:03:09.969438] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.157 [2024-04-26 18:03:09.969449] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.157 [2024-04-26 18:03:09.969481] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.157 [2024-04-26 18:03:09.969491] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.157 [2024-04-26 18:03:11.974417] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.157 [2024-04-26 18:03:11.974453] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.157 [2024-04-26 18:03:11.974482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.157 [2024-04-26 18:03:11.974493] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.157 [2024-04-26 18:03:11.974507] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.157 [2024-04-26 18:03:11.974516] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.157 [2024-04-26 18:03:11.974527] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.157 [2024-04-26 18:03:11.974554] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.158 [2024-04-26 18:03:11.974564] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.158 [2024-04-26 18:03:13.979493] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.158 [2024-04-26 18:03:13.979528] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.158 [2024-04-26 18:03:13.979556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.158 [2024-04-26 18:03:13.979568] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.158 [2024-04-26 18:03:13.979581] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.158 [2024-04-26 18:03:13.979591] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.158 [2024-04-26 18:03:13.979602] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.158 [2024-04-26 18:03:13.979629] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.158 [2024-04-26 18:03:13.979640] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.158 [2024-04-26 18:03:15.258107] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno No such device or address (6) 00:16:24.158 [2024-04-26 18:03:15.258191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.158 [2024-04-26 18:03:15.258237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.158 [2024-04-26 18:03:15.258249] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.158 [2024-04-26 18:03:15.258259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.158 [2024-04-26 18:03:15.258269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.158 [2024-04-26 18:03:15.258279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.158 [2024-04-26 18:03:15.258289] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:16:24.158 [2024-04-26 18:03:15.258298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32735 cdw0:6 sqhd:73b9 p:0 m:0 dnr:0 00:16:24.158 [2024-04-26 18:03:15.274035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.158 [2024-04-26 18:03:15.274060] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.158 [2024-04-26 18:03:15.274092] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:24.158 [2024-04-26 18:03:15.274189] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.284192] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.294218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.304247] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.314272] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.324297] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.334322] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.344352] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.354378] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.364406] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.374435] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.384462] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.394487] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.404515] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.414543] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.424569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.434594] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.444623] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.454647] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.464676] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.474702] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.484726] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.494754] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.504781] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.514809] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.524838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.534865] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.544893] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.554919] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.564946] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.574973] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.585003] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.595028] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.605053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.615082] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.625111] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.635139] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.645164] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.655193] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.665218] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.675247] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.685272] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.695299] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.705329] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.715356] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.725380] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.735409] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.745434] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.755464] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.765488] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.775517] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.785546] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.795573] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.805598] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.815623] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.825648] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.835675] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.845702] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.855727] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.865755] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.875781] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.885810] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.895835] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.905860] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.915886] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.925912] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.158 [2024-04-26 18:03:15.935940] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.945967] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.955996] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.966021] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.976050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.984565] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.159 [2024-04-26 18:03:15.984576] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:16:24.159 [2024-04-26 18:03:15.984597] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.159 [2024-04-26 18:03:15.984607] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:16:24.159 [2024-04-26 18:03:15.984620] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:16:24.159 [2024-04-26 18:03:15.984630] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:16:24.159 [2024-04-26 18:03:15.984640] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:16:24.159 [2024-04-26 18:03:15.984662] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.159 [2024-04-26 18:03:15.984672] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:16:24.159 [2024-04-26 18:03:15.986072] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:15.996094] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.006120] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.016146] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.026171] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.036195] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.046222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.056250] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.066276] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.076303] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.086330] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.096357] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.106384] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.116409] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.126434] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.136459] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.146485] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.156513] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.166539] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.176564] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.186590] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.196618] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.206645] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.216670] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.226696] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.236724] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.246748] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.256775] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.266800] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:16:24.159 [2024-04-26 18:03:16.276549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:48328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:48336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:48344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:48352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:48360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:48368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:48376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:48384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:48392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:48400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:48408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:48416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:48424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:48432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:48440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:48448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:48456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:48464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.276978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:48472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.276988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.277001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:48480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.159 [2024-04-26 18:03:16.277013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.159 [2024-04-26 18:03:16.277026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:48488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:48496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:48504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:48512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:48520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:48528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:48536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:48544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:48552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:48560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:48568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:48576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:48584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:48592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:48600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:48608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:48616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:48624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:48632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:48640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:48648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:48656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:48664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:48672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:48680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:48688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:48696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:48704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:48712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:48720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:48728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:48736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:48744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:48752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:48760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:48768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:48776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:48784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.160 [2024-04-26 18:03:16.277861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:48792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.160 [2024-04-26 18:03:16.277870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.277882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:48800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.161 [2024-04-26 18:03:16.277891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.277903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:48808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.161 [2024-04-26 18:03:16.277912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.277923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:48816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.161 [2024-04-26 18:03:16.277932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.277943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:48824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.161 [2024-04-26 18:03:16.277952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.277962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:48832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:16:24.161 [2024-04-26 18:03:16.277972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32735 cdw0:c116d250 sqhd:4530 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.290930] rdma_verbs.c: 83:spdk_rdma_qp_destroy: *WARNING*: Destroying qpair with queued Work Requests 00:16:24.161 [2024-04-26 18:03:16.290993] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:24.161 [2024-04-26 18:03:16.291002] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:24.161 [2024-04-26 18:03:16.291015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:48840 len:8 PRP1 0x0 PRP2 0x0 00:16:24.161 [2024-04-26 18:03:16.291025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.291038] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:16:24.161 [2024-04-26 18:03:16.291045] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:16:24.161 [2024-04-26 18:03:16.291053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:48848 len:8 PRP1 0x0 PRP2 0x0 00:16:24.161 [2024-04-26 18:03:16.291063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:24.161 [2024-04-26 18:03:16.291114] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:16.291372] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.161 [2024-04-26 18:03:16.291385] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:16.291393] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:16.291409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:16.291420] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.161 [2024-04-26 18:03:16.291431] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.161 [2024-04-26 18:03:16.291440] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.161 [2024-04-26 18:03:16.291450] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.161 [2024-04-26 18:03:16.291469] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.161 [2024-04-26 18:03:16.291477] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:17.031585] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:24.161 [2024-04-26 18:03:17.293975] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.161 [2024-04-26 18:03:17.293995] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:17.294003] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:17.294024] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:17.294034] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.161 [2024-04-26 18:03:17.294046] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.161 [2024-04-26 18:03:17.294055] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.161 [2024-04-26 18:03:17.294066] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.161 [2024-04-26 18:03:17.294084] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.161 [2024-04-26 18:03:17.294093] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:18.296645] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:16:24.161 [2024-04-26 18:03:18.296686] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:18.296695] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:18.296718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:18.296728] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.161 [2024-04-26 18:03:18.296741] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.161 [2024-04-26 18:03:18.296751] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.161 [2024-04-26 18:03:18.296761] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.161 [2024-04-26 18:03:18.296785] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.161 [2024-04-26 18:03:18.296794] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:20.302908] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:20.302953] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:20.302983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:20.302995] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.161 [2024-04-26 18:03:20.303879] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.161 [2024-04-26 18:03:20.303894] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.161 [2024-04-26 18:03:20.303907] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.161 [2024-04-26 18:03:20.303945] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.161 [2024-04-26 18:03:20.303955] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:22.309587] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:22.309624] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:22.309652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:22.309664] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.161 [2024-04-26 18:03:22.309678] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:16:24.161 [2024-04-26 18:03:22.310384] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.161 [2024-04-26 18:03:22.310397] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.161 [2024-04-26 18:03:22.310409] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.161 [2024-04-26 18:03:22.310451] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.161 [2024-04-26 18:03:22.310490] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.161 [2024-04-26 18:03:23.313020] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.161 [2024-04-26 18:03:23.313064] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.161 [2024-04-26 18:03:23.313096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.161 [2024-04-26 18:03:23.313107] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.162 [2024-04-26 18:03:23.314507] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.162 [2024-04-26 18:03:23.314523] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.162 [2024-04-26 18:03:23.314535] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.162 [2024-04-26 18:03:23.314590] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.162 [2024-04-26 18:03:23.314600] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.162 [2024-04-26 18:03:25.321504] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:16:24.162 [2024-04-26 18:03:25.321537] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:16:24.162 [2024-04-26 18:03:25.321566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:16:24.162 [2024-04-26 18:03:25.321578] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:16:24.162 [2024-04-26 18:03:25.322760] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:16:24.162 [2024-04-26 18:03:25.322776] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:16:24.162 [2024-04-26 18:03:25.322788] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:16:24.162 [2024-04-26 18:03:25.322822] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:16:24.162 [2024-04-26 18:03:25.322833] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:16:24.162 [2024-04-26 18:03:26.382263] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:24.162 00:16:24.162 Latency(us) 00:16:24.162 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:24.162 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:24.162 Verification LBA range: start 0x0 length 0x8000 00:16:24.162 Nvme_mlx_0_0n1 : 90.01 10707.85 41.83 0.00 0.00 11935.03 1980.33 13071639.60 00:16:24.162 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:16:24.162 Verification LBA range: start 0x0 length 0x8000 00:16:24.162 Nvme_mlx_0_1n1 : 90.01 9536.67 37.25 0.00 0.00 13403.57 1146.88 12079595.52 00:16:24.162 =================================================================================================================== 00:16:24.162 Total : 20244.52 79.08 0.00 0.00 12626.83 1146.88 13071639.60 00:16:24.162 Received shutdown signal, test time was about 90.000000 seconds 00:16:24.162 00:16:24.162 Latency(us) 00:16:24.162 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:24.162 =================================================================================================================== 00:16:24.162 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:24.162 18:04:30 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:16:24.162 18:04:30 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:16:24.162 18:04:30 -- target/device_removal.sh@202 -- # killprocess 963840 00:16:24.162 18:04:30 -- common/autotest_common.sh@946 -- # '[' -z 963840 ']' 00:16:24.162 18:04:30 -- common/autotest_common.sh@950 -- # kill -0 963840 00:16:24.162 18:04:30 -- common/autotest_common.sh@951 -- # uname 00:16:24.162 18:04:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:16:24.162 18:04:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 963840 00:16:24.162 18:04:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:16:24.162 18:04:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:16:24.162 18:04:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 963840' 00:16:24.162 killing process with pid 963840 00:16:24.162 18:04:30 -- common/autotest_common.sh@965 -- # kill 963840 00:16:24.162 18:04:30 -- common/autotest_common.sh@970 -- # wait 963840 00:16:24.162 [2024-04-26 18:04:30.501155] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:16:24.162 18:04:30 -- target/device_removal.sh@203 -- # nvmfpid= 00:16:24.162 18:04:30 -- target/device_removal.sh@205 -- # return 0 00:16:24.162 00:16:24.162 real 1m33.296s 00:16:24.162 user 4m25.354s 00:16:24.162 sys 0m4.671s 00:16:24.162 18:04:30 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:16:24.162 18:04:30 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 ************************************ 00:16:24.162 END TEST nvmf_device_removal_pci_remove_no_srq 00:16:24.162 ************************************ 00:16:24.162 18:04:30 -- target/device_removal.sh@312 -- # run_test nvmf_device_removal_pci_remove test_remove_and_rescan 00:16:24.162 18:04:30 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:16:24.162 18:04:30 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:16:24.162 18:04:30 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 ************************************ 00:16:24.162 START TEST nvmf_device_removal_pci_remove 00:16:24.162 ************************************ 00:16:24.162 18:04:31 -- common/autotest_common.sh@1121 -- # test_remove_and_rescan 00:16:24.162 18:04:31 -- target/device_removal.sh@128 -- # nvmfappstart -m 0x3 00:16:24.162 18:04:31 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:16:24.162 18:04:31 -- common/autotest_common.sh@720 -- # xtrace_disable 00:16:24.162 18:04:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 18:04:31 -- nvmf/common.sh@470 -- # nvmfpid=976845 00:16:24.162 18:04:31 -- nvmf/common.sh@471 -- # waitforlisten 976845 00:16:24.162 18:04:31 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:16:24.162 18:04:31 -- common/autotest_common.sh@827 -- # '[' -z 976845 ']' 00:16:24.162 18:04:31 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:24.162 18:04:31 -- common/autotest_common.sh@832 -- # local max_retries=100 00:16:24.162 18:04:31 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:24.162 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:24.162 18:04:31 -- common/autotest_common.sh@836 -- # xtrace_disable 00:16:24.162 18:04:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 [2024-04-26 18:04:31.055824] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:16:24.162 [2024-04-26 18:04:31.055882] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:24.162 EAL: No free 2048 kB hugepages reported on node 1 00:16:24.162 [2024-04-26 18:04:31.131656] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:16:24.162 [2024-04-26 18:04:31.218493] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:24.162 [2024-04-26 18:04:31.218539] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:24.162 [2024-04-26 18:04:31.218549] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:16:24.162 [2024-04-26 18:04:31.218562] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:16:24.162 [2024-04-26 18:04:31.218570] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:24.162 [2024-04-26 18:04:31.218624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:24.162 [2024-04-26 18:04:31.218626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:24.162 18:04:31 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:16:24.162 18:04:31 -- common/autotest_common.sh@860 -- # return 0 00:16:24.162 18:04:31 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:16:24.162 18:04:31 -- common/autotest_common.sh@726 -- # xtrace_disable 00:16:24.162 18:04:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 18:04:31 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:24.162 18:04:31 -- target/device_removal.sh@130 -- # create_subsystem_and_connect 00:16:24.162 18:04:31 -- target/device_removal.sh@45 -- # local -gA netdev_nvme_dict 00:16:24.162 18:04:31 -- target/device_removal.sh@46 -- # netdev_nvme_dict=() 00:16:24.162 18:04:31 -- target/device_removal.sh@48 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:16:24.162 18:04:31 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.162 18:04:31 -- common/autotest_common.sh@10 -- # set +x 00:16:24.162 [2024-04-26 18:04:31.937293] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a3cf40/0x1a41430) succeed. 00:16:24.162 [2024-04-26 18:04:31.946421] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a3e440/0x1a82ac0) succeed. 00:16:24.162 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.162 18:04:32 -- target/device_removal.sh@49 -- # get_rdma_if_list 00:16:24.162 18:04:32 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:16:24.162 18:04:32 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:16:24.162 18:04:32 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:16:24.162 18:04:32 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:16:24.162 18:04:32 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:16:24.162 18:04:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.162 18:04:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.162 18:04:32 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:16:24.162 18:04:32 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:16:24.162 18:04:32 -- nvmf/common.sh@105 -- # continue 2 00:16:24.162 18:04:32 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:16:24.162 18:04:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.162 18:04:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:16:24.162 18:04:32 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:16:24.162 18:04:32 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:16:24.162 18:04:32 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:16:24.162 18:04:32 -- nvmf/common.sh@105 -- # continue 2 00:16:24.162 18:04:32 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:24.162 18:04:32 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:24.162 18:04:32 -- target/device_removal.sh@27 -- # dev_name=mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:24.162 18:04:32 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_0 00:16:24.162 18:04:32 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.163 18:04:32 -- target/device_removal.sh@30 -- # ip=192.168.100.8 00:16:24.163 18:04:32 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_0 00:16:24.163 18:04:32 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:24.163 18:04:32 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:24.163 18:04:32 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_0 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_0 -a -s SPDK000mlx_0_0 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_0 mlx_0_0 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 [2024-04-26 18:04:32.138445] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@41 -- # return 0 00:16:24.163 18:04:32 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_0 00:16:24.163 18:04:32 -- target/device_removal.sh@49 -- # for net_dev in $(get_rdma_if_list) 00:16:24.163 18:04:32 -- target/device_removal.sh@50 -- # create_subsystem_and_connect_on_netdev mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@25 -- # local -a dev_name 00:16:24.163 18:04:32 -- target/device_removal.sh@27 -- # dev_name=mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@28 -- # malloc_name=mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@29 -- # get_subsystem_nqn mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@29 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@30 -- # get_ip_address mlx_0_1 00:16:24.163 18:04:32 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.163 18:04:32 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.163 18:04:32 -- target/device_removal.sh@30 -- # ip=192.168.100.9 00:16:24.163 18:04:32 -- target/device_removal.sh@31 -- # serial=SPDK000mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@33 -- # MALLOC_BDEV_SIZE=128 00:16:24.163 18:04:32 -- target/device_removal.sh@34 -- # MALLOC_BLOCK_SIZE=512 00:16:24.163 18:04:32 -- target/device_removal.sh@36 -- # rpc_cmd bdev_malloc_create 128 512 -b mlx_0_1 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:system_mlx_0_1 -a -s SPDK000mlx_0_1 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:system_mlx_0_1 mlx_0_1 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:system_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 00:16:24.163 18:04:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 [2024-04-26 18:04:32.217905] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:24.163 18:04:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:32 -- target/device_removal.sh@41 -- # return 0 00:16:24.163 18:04:32 -- target/device_removal.sh@50 -- # netdev_nvme_dict[$net_dev]=mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@53 -- # return 0 00:16:24.163 18:04:32 -- target/device_removal.sh@132 -- # generate_io_traffic_with_bdevperf mlx_0_0 mlx_0_1 00:16:24.163 18:04:32 -- target/device_removal.sh@87 -- # dev_names=('mlx_0_0' 'mlx_0_1') 00:16:24.163 18:04:32 -- target/device_removal.sh@87 -- # local dev_names 00:16:24.163 18:04:32 -- target/device_removal.sh@89 -- # mkdir -p /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:16:24.163 18:04:32 -- target/device_removal.sh@91 -- # bdevperf_pid=977005 00:16:24.163 18:04:32 -- target/device_removal.sh@93 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; kill -9 $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:24.163 18:04:32 -- target/device_removal.sh@90 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 90 00:16:24.163 18:04:32 -- target/device_removal.sh@94 -- # waitforlisten 977005 /var/tmp/bdevperf.sock 00:16:24.163 18:04:32 -- common/autotest_common.sh@827 -- # '[' -z 977005 ']' 00:16:24.163 18:04:32 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:24.163 18:04:32 -- common/autotest_common.sh@832 -- # local max_retries=100 00:16:24.163 18:04:32 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:24.163 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:24.163 18:04:32 -- common/autotest_common.sh@836 -- # xtrace_disable 00:16:24.163 18:04:32 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:33 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:16:24.163 18:04:33 -- common/autotest_common.sh@860 -- # return 0 00:16:24.163 18:04:33 -- target/device_removal.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_set_options -r -1 00:16:24.163 18:04:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:33 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 18:04:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:33 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:24.163 18:04:33 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_0 00:16:24.163 18:04:33 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_0 00:16:24.163 18:04:33 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_0 00:16:24.163 18:04:33 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_0 00:16:24.163 18:04:33 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.163 18:04:33 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.8 00:16:24.163 18:04:33 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_0 -l -1 -o 1 00:16:24.163 18:04:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:33 -- common/autotest_common.sh@10 -- # set +x 00:16:24.163 Nvme_mlx_0_0n1 00:16:24.163 18:04:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.163 18:04:33 -- target/device_removal.sh@100 -- # for dev_name in "${dev_names[@]}" 00:16:24.163 18:04:33 -- target/device_removal.sh@101 -- # get_subsystem_nqn mlx_0_1 00:16:24.163 18:04:33 -- target/device_removal.sh@21 -- # echo nqn.2016-06.io.spdk:system_mlx_0_1 00:16:24.163 18:04:33 -- target/device_removal.sh@101 -- # nqn=nqn.2016-06.io.spdk:system_mlx_0_1 00:16:24.163 18:04:33 -- target/device_removal.sh@102 -- # get_ip_address mlx_0_1 00:16:24.163 18:04:33 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:24.163 18:04:33 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:24.163 18:04:33 -- target/device_removal.sh@102 -- # tgt_ip=192.168.100.9 00:16:24.163 18:04:33 -- target/device_removal.sh@106 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme_mlx_0_1 -t rdma -a 192.168.100.9 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:system_mlx_0_1 -l -1 -o 1 00:16:24.163 18:04:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:24.163 18:04:33 -- common/autotest_common.sh@10 -- # set +x 00:16:24.421 Nvme_mlx_0_1n1 00:16:24.421 18:04:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:24.421 18:04:33 -- target/device_removal.sh@110 -- # bdevperf_rpc_pid=977197 00:16:24.421 18:04:33 -- target/device_removal.sh@109 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 120 -s /var/tmp/bdevperf.sock perform_tests 00:16:24.421 18:04:33 -- target/device_removal.sh@112 -- # sleep 5 00:16:29.714 18:04:38 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:29.714 18:04:38 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@71 -- # dev_name=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:29.714 18:04:38 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/infiniband 00:16:29.714 18:04:38 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_0 00:16:29.714 18:04:38 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_0 00:16:29.714 18:04:38 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:29.714 18:04:38 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:29.714 18:04:38 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:29.714 18:04:38 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:29.714 18:04:38 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.8 00:16:29.714 18:04:38 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:29.714 18:04:38 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0 00:16:29.714 18:04:38 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:29.714 18:04:38 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:29.714 18:04:38 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:29.714 18:04:38 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:29.714 18:04:38 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:29.714 18:04:38 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:29.714 18:04:38 -- common/autotest_common.sh@10 -- # set +x 00:16:29.714 18:04:38 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:29.714 mlx5_0 00:16:29.714 18:04:38 -- target/device_removal.sh@78 -- # return 0 00:16:29.714 18:04:38 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@66 -- # dev_name=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@67 -- # echo 1 00:16:29.714 18:04:38 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@61 -- # dev_name=mlx_0_0 00:16:29.714 18:04:38 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.0/net/mlx_0_0/device 00:16:29.714 [2024-04-26 18:04:38.504448] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.8:4420 on device mlx5_0 is being removed. 00:16:29.714 [2024-04-26 18:04:38.504546] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:29.714 [2024-04-26 18:04:38.506845] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:29.714 [2024-04-26 18:04:38.506871] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 64 00:16:34.981 18:04:44 -- target/device_removal.sh@147 -- # seq 1 10 00:16:34.981 18:04:44 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:34.981 18:04:44 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_0 00:16:34.981 18:04:44 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_0 00:16:34.981 18:04:44 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:34.981 18:04:44 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:34.981 18:04:44 -- target/device_removal.sh@77 -- # grep mlx5_0 00:16:34.981 18:04:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.981 18:04:44 -- common/autotest_common.sh@10 -- # set +x 00:16:34.981 18:04:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.981 18:04:44 -- target/device_removal.sh@78 -- # return 1 00:16:34.981 18:04:44 -- target/device_removal.sh@149 -- # break 00:16:34.981 18:04:44 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:34.981 18:04:44 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:34.981 18:04:44 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:34.981 18:04:44 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:34.981 18:04:44 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:34.981 18:04:44 -- common/autotest_common.sh@10 -- # set +x 00:16:34.981 18:04:44 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:34.981 18:04:44 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:34.981 18:04:44 -- target/device_removal.sh@160 -- # rescan_pci 00:16:34.981 18:04:44 -- target/device_removal.sh@57 -- # echo 1 00:16:35.917 [2024-04-26 18:04:45.035640] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1b1aa00, err 11. Skip rescan. 00:16:35.917 [2024-04-26 18:04:45.041501] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1b1aa00, err 11. Skip rescan. 00:16:36.176 18:04:45 -- target/device_removal.sh@162 -- # seq 1 10 00:16:36.176 18:04:45 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:36.176 18:04:45 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.0/net 00:16:36.176 18:04:45 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_0 00:16:36.176 18:04:45 -- target/device_removal.sh@164 -- # [[ -z mlx_0_0 ]] 00:16:36.176 18:04:45 -- target/device_removal.sh@166 -- # [[ mlx_0_0 != \m\l\x\_\0\_\0 ]] 00:16:36.176 18:04:45 -- target/device_removal.sh@171 -- # break 00:16:36.176 18:04:45 -- target/device_removal.sh@175 -- # [[ -z mlx_0_0 ]] 00:16:36.176 18:04:45 -- target/device_removal.sh@179 -- # ip link set mlx_0_0 up 00:16:36.434 [2024-04-26 18:04:45.421512] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1a3fbd0/0x1a41430) succeed. 00:16:36.434 [2024-04-26 18:04:45.421581] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.8:4420 is still failed(-1) to listen. 00:16:39.730 18:04:48 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_0 00:16:39.730 18:04:48 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:39.731 18:04:48 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:39.731 18:04:48 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.8/24 dev mlx_0_0 00:16:39.731 18:04:48 -- target/device_removal.sh@186 -- # seq 1 10 00:16:39.731 [2024-04-26 18:04:48.403577] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:39.731 18:04:48 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:39.731 18:04:48 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:39.731 18:04:48 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:39.731 18:04:48 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:39.731 18:04:48 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:39.731 18:04:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:39.731 18:04:48 -- common/autotest_common.sh@10 -- # set +x 00:16:39.731 [2024-04-26 18:04:48.451246] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:16:39.731 [2024-04-26 18:04:48.451282] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.8:4420 come back 00:16:39.731 [2024-04-26 18:04:48.451302] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:39.731 18:04:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:39.731 18:04:48 -- target/device_removal.sh@187 -- # ib_count=2 00:16:39.731 18:04:48 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:39.731 18:04:48 -- target/device_removal.sh@189 -- # break 00:16:39.731 18:04:48 -- target/device_removal.sh@134 -- # for net_dev in "${!netdev_nvme_dict[@]}" 00:16:39.731 18:04:48 -- target/device_removal.sh@135 -- # nvme_dev=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@136 -- # get_rdma_device_name mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@71 -- # dev_name=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@72 -- # get_pci_dir mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:39.731 18:04:48 -- target/device_removal.sh@72 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/infiniband 00:16:39.731 18:04:48 -- target/device_removal.sh@136 -- # rdma_dev_name=mlx5_1 00:16:39.731 18:04:48 -- target/device_removal.sh@137 -- # get_ip_address mlx_0_1 00:16:39.731 18:04:48 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:39.731 18:04:48 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:39.731 18:04:48 -- target/device_removal.sh@137 -- # origin_ip=192.168.100.9 00:16:39.731 18:04:48 -- target/device_removal.sh@138 -- # get_pci_dir mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:39.731 18:04:48 -- target/device_removal.sh@138 -- # pci_dir=/sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1 00:16:39.731 18:04:48 -- target/device_removal.sh@140 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:39.731 18:04:48 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:39.731 18:04:48 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:39.731 18:04:48 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:39.731 18:04:48 -- common/autotest_common.sh@10 -- # set +x 00:16:39.731 18:04:48 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:39.731 18:04:48 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:39.731 18:04:48 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:39.731 mlx5_1 00:16:39.731 18:04:48 -- target/device_removal.sh@78 -- # return 0 00:16:39.731 18:04:48 -- target/device_removal.sh@145 -- # remove_one_nic mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@66 -- # dev_name=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@67 -- # echo 1 00:16:39.731 18:04:48 -- target/device_removal.sh@67 -- # get_pci_dir mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@61 -- # dev_name=mlx_0_1 00:16:39.731 18:04:48 -- target/device_removal.sh@62 -- # readlink -f /sys/bus/pci/devices/0000:18:00.1/net/mlx_0_1/device 00:16:39.731 [2024-04-26 18:04:48.636653] rdma.c:3563:nvmf_rdma_handle_device_removal: *NOTICE*: Port 192.168.100.9:4420 on device mlx5_1 is being removed. 00:16:39.731 [2024-04-26 18:04:48.636728] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:39.731 [2024-04-26 18:04:48.643909] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:16:39.731 [2024-04-26 18:04:48.643927] rdma.c: 845:nvmf_rdma_qpair_destroy: *WARNING*: Destroying qpair when queue depth is 127 00:16:46.285 18:04:54 -- target/device_removal.sh@147 -- # seq 1 10 00:16:46.285 18:04:54 -- target/device_removal.sh@147 -- # for i in $(seq 1 10) 00:16:46.285 18:04:54 -- target/device_removal.sh@148 -- # check_rdma_dev_exists_in_nvmf_tgt mlx5_1 00:16:46.285 18:04:54 -- target/device_removal.sh@76 -- # local rdma_dev_name=mlx5_1 00:16:46.285 18:04:54 -- target/device_removal.sh@77 -- # rpc_cmd nvmf_get_stats 00:16:46.285 18:04:54 -- target/device_removal.sh@77 -- # jq -r '.poll_groups[0].transports[].devices[].name' 00:16:46.285 18:04:54 -- target/device_removal.sh@77 -- # grep mlx5_1 00:16:46.285 18:04:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:46.285 18:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:46.285 18:04:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:46.285 18:04:54 -- target/device_removal.sh@78 -- # return 1 00:16:46.285 18:04:54 -- target/device_removal.sh@149 -- # break 00:16:46.285 18:04:54 -- target/device_removal.sh@158 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:46.285 18:04:54 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:46.285 18:04:54 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:46.285 18:04:54 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:46.285 18:04:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:46.285 18:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:46.285 18:04:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:46.285 18:04:54 -- target/device_removal.sh@158 -- # ib_count_after_remove=1 00:16:46.285 18:04:54 -- target/device_removal.sh@160 -- # rescan_pci 00:16:46.285 18:04:54 -- target/device_removal.sh@57 -- # echo 1 00:16:46.285 [2024-04-26 18:04:55.247473] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1a2a040, err 11. Skip rescan. 00:16:46.285 [2024-04-26 18:04:55.252786] rdma.c:3252:nvmf_rdma_rescan_devices: *WARNING*: Failed to init ibv device 0x1a2a040, err 11. Skip rescan. 00:16:46.285 18:04:55 -- target/device_removal.sh@162 -- # seq 1 10 00:16:46.285 18:04:55 -- target/device_removal.sh@162 -- # for i in $(seq 1 10) 00:16:46.285 18:04:55 -- target/device_removal.sh@163 -- # ls /sys/devices/pci0000:17/0000:17:00.0/0000:18:00.1/net 00:16:46.285 18:04:55 -- target/device_removal.sh@163 -- # new_net_dev=mlx_0_1 00:16:46.285 18:04:55 -- target/device_removal.sh@164 -- # [[ -z mlx_0_1 ]] 00:16:46.285 18:04:55 -- target/device_removal.sh@166 -- # [[ mlx_0_1 != \m\l\x\_\0\_\1 ]] 00:16:46.285 18:04:55 -- target/device_removal.sh@171 -- # break 00:16:46.285 18:04:55 -- target/device_removal.sh@175 -- # [[ -z mlx_0_1 ]] 00:16:46.285 18:04:55 -- target/device_removal.sh@179 -- # ip link set mlx_0_1 up 00:16:46.544 [2024-04-26 18:04:55.641920] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1a40250/0x1a82ac0) succeed. 00:16:46.544 [2024-04-26 18:04:55.642021] rdma.c:3305:nvmf_rdma_retry_listen_port: *ERROR*: Found new IB device but port 192.168.100.9:4420 is still failed(-1) to listen. 00:16:49.864 18:04:58 -- target/device_removal.sh@180 -- # get_ip_address mlx_0_1 00:16:49.864 18:04:58 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:16:49.864 18:04:58 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:16:49.864 18:04:58 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:16:49.864 18:04:58 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:16:49.864 18:04:58 -- target/device_removal.sh@180 -- # [[ -z '' ]] 00:16:49.864 18:04:58 -- target/device_removal.sh@181 -- # ip addr add 192.168.100.9/24 dev mlx_0_1 00:16:49.864 18:04:58 -- target/device_removal.sh@186 -- # seq 1 10 00:16:49.864 18:04:58 -- target/device_removal.sh@186 -- # for i in $(seq 1 10) 00:16:49.864 18:04:58 -- target/device_removal.sh@187 -- # get_rdma_dev_count_in_nvmf_tgt 00:16:49.864 18:04:58 -- target/device_removal.sh@82 -- # local rdma_dev_name= 00:16:49.864 18:04:58 -- target/device_removal.sh@83 -- # rpc_cmd nvmf_get_stats 00:16:49.864 18:04:58 -- target/device_removal.sh@83 -- # jq -r '.poll_groups[0].transports[].devices | length' 00:16:49.864 18:04:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:16:49.864 18:04:58 -- common/autotest_common.sh@10 -- # set +x 00:16:49.864 [2024-04-26 18:04:58.726181] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:16:49.864 [2024-04-26 18:04:58.726218] rdma.c:3311:nvmf_rdma_retry_listen_port: *NOTICE*: Port 192.168.100.9:4420 come back 00:16:49.864 [2024-04-26 18:04:58.726238] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:49.864 [2024-04-26 18:04:58.726255] rdma.c:3841:nvmf_process_ib_event: *NOTICE*: Async event: GID table change 00:16:49.864 18:04:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:16:49.864 18:04:58 -- target/device_removal.sh@187 -- # ib_count=2 00:16:49.864 18:04:58 -- target/device_removal.sh@188 -- # (( ib_count > ib_count_after_remove )) 00:16:49.864 18:04:58 -- target/device_removal.sh@189 -- # break 00:16:49.864 18:04:58 -- target/device_removal.sh@200 -- # stop_bdevperf 00:16:49.864 18:04:58 -- target/device_removal.sh@116 -- # wait 977197 00:17:57.569 0 00:17:57.569 18:06:03 -- target/device_removal.sh@118 -- # killprocess 977005 00:17:57.569 18:06:03 -- common/autotest_common.sh@946 -- # '[' -z 977005 ']' 00:17:57.569 18:06:03 -- common/autotest_common.sh@950 -- # kill -0 977005 00:17:57.569 18:06:03 -- common/autotest_common.sh@951 -- # uname 00:17:57.569 18:06:03 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:17:57.569 18:06:03 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 977005 00:17:57.569 18:06:03 -- common/autotest_common.sh@952 -- # process_name=reactor_2 00:17:57.569 18:06:03 -- common/autotest_common.sh@956 -- # '[' reactor_2 = sudo ']' 00:17:57.569 18:06:03 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 977005' 00:17:57.569 killing process with pid 977005 00:17:57.569 18:06:03 -- common/autotest_common.sh@965 -- # kill 977005 00:17:57.569 18:06:03 -- common/autotest_common.sh@970 -- # wait 977005 00:17:57.569 18:06:03 -- target/device_removal.sh@119 -- # bdevperf_pid= 00:17:57.569 18:06:03 -- target/device_removal.sh@121 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:57.569 [2024-04-26 18:04:32.273734] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:17:57.569 [2024-04-26 18:04:32.273786] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid977005 ] 00:17:57.569 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.569 [2024-04-26 18:04:32.341760] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.569 [2024-04-26 18:04:32.420736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:57.569 Running I/O for 90 seconds... 00:17:57.569 [2024-04-26 18:04:38.505295] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:57.569 [2024-04-26 18:04:38.505333] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.569 [2024-04-26 18:04:38.505354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.569 [2024-04-26 18:04:38.505366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.569 [2024-04-26 18:04:38.505376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.569 [2024-04-26 18:04:38.505386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.569 [2024-04-26 18:04:38.505396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.569 [2024-04-26 18:04:38.505405] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.569 [2024-04-26 18:04:38.505415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.569 [2024-04-26 18:04:38.510374] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.569 [2024-04-26 18:04:38.510411] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.569 [2024-04-26 18:04:38.510450] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:57.569 [2024-04-26 18:04:38.515299] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.525318] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.535348] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.545698] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.556050] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.566076] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.576131] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.586422] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.596667] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.606984] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.617138] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.627417] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.637677] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.647943] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.658254] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.668443] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.678685] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.688940] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.699195] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.709401] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.719626] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.729901] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.740154] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.750697] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.761003] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.771308] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.781535] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.791778] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.802046] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.812295] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.822581] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.832875] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.843092] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.853226] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.863507] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.873740] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.884020] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.894079] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.904368] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.914684] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.925244] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.935510] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.945782] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.956078] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.966349] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.976488] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.986838] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:38.997123] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.007855] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.018217] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.028539] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.038819] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.048931] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.059122] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.069567] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.079903] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.089956] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.569 [2024-04-26 18:04:39.100222] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.110686] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.120963] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.131468] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.141493] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.151644] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.162004] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.172506] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.182536] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.192754] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.203002] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.213541] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.223570] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.233978] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.244151] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.254354] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.264647] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.275103] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.285395] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.295607] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.305857] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.315881] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.326335] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.336598] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.346863] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.356888] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.366913] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.377132] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.387472] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.397762] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.407926] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.418062] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.428375] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.438626] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.448789] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.459091] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.469384] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.479734] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.490130] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.500436] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.510797] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.570 [2024-04-26 18:04:39.512904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:196112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000777a000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.512923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.512944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:196120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007778000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.512958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.512969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:196128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007776000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.512979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.512991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:196136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007774000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:196144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007772000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:196152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007770000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:196160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776e000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:196168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776c000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:196176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000776a000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:196184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007768000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:196192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007766000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:196200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007764000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:196208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007762000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:196216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007760000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:196224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775e000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:196232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775c000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:196240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000775a000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:196248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007758000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:196256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007756000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.570 [2024-04-26 18:04:39.513318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:196264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007754000 len:0x1000 key:0x1810ef 00:17:57.570 [2024-04-26 18:04:39.513327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:196272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007752000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:196280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007750000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:196288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774e000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:196296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774c000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:196304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000774a000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:196312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007748000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:196320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007746000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:196328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007744000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:196336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007742000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:196344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007740000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:196352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773e000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:196360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773c000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:196368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000773a000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:196376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007738000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:196384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007736000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:196392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007734000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:196400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007732000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:196408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007730000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:196416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772e000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:196424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772c000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:196432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000772a000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:196440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007728000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:196448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007726000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:196456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007724000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:196464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007722000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:196472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007720000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:196480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771e000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:196488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771c000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:196496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000771a000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:196504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007718000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:196512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007716000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.513979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:196520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007714000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.513988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.514000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:196528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007712000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.514009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.514020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:196536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007710000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.514029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.514039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:196544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770e000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.514049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.571 [2024-04-26 18:04:39.514060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:196552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770c000 len:0x1000 key:0x1810ef 00:17:57.571 [2024-04-26 18:04:39.514069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:196560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000770a000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:196568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007708000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:196576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007706000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:196584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007704000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:196592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007702000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:196600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007700000 len:0x1000 key:0x1810ef 00:17:57.572 [2024-04-26 18:04:39.514191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:196608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:196616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:196624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:196632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:196640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:196648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:196656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:196664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:196672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:196680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:196688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:196696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:196704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:196712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:196720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:196728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:196736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:196744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:196752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:196760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:196768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:196776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:196784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:196792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:196800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:196808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:196816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:196824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:196832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:196840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:196848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:196856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.572 [2024-04-26 18:04:39.514842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.572 [2024-04-26 18:04:39.514853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:196864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:196872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:196880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:196888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:196896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:196904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:196912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.514983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.514993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:196920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:196928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:196936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:196944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:196952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:196960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:196968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:196976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:196984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:196992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:197000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:197008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:197016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:197024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:197032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:197040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:197048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:197056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:197064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:197072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:197080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:197088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:197096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:197104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.573 [2024-04-26 18:04:39.515481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:197112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.573 [2024-04-26 18:04:39.515490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:39.515500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:197120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.574 [2024-04-26 18:04:39.515509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:39.528530] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:57.574 [2024-04-26 18:04:39.528546] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:57.574 [2024-04-26 18:04:39.528555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:197128 len:8 PRP1 0x0 PRP2 0x0 00:17:57.574 [2024-04-26 18:04:39.528565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:39.531310] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:39.531599] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.574 [2024-04-26 18:04:39.531616] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:39.531628] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:39.531647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:39.531657] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:39.531674] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:39.531684] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:39.531694] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:39.531716] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:39.531725] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:40.534234] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.574 [2024-04-26 18:04:40.534276] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:40.534286] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:40.534310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:40.534321] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:40.534334] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:40.534349] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:40.534360] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:40.534386] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:40.534396] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:41.537965] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.574 [2024-04-26 18:04:41.538005] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:41.538015] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:41.538037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:41.538047] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:41.538061] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:41.538070] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:41.538080] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:41.538104] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:41.538114] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:43.544790] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:43.544834] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:43.544878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:43.544889] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:43.544904] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:43.544913] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:43.544924] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:43.544958] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:43.544969] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:45.550219] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:45.550254] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:45.550284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:45.550295] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:45.550309] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:45.550318] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:45.550329] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:45.550358] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:45.550368] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:47.555291] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.574 [2024-04-26 18:04:47.555325] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:17:57.574 [2024-04-26 18:04:47.555357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:47.555368] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] in failed state. 00:17:57.574 [2024-04-26 18:04:47.555381] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] Ctrlr is in error state 00:17:57.574 [2024-04-26 18:04:47.555391] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_0] controller reinitialization failed 00:17:57.574 [2024-04-26 18:04:47.555402] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] already in failed state 00:17:57.574 [2024-04-26 18:04:47.555427] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.574 [2024-04-26 18:04:47.555437] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_0] resetting controller 00:17:57.574 [2024-04-26 18:04:48.611286] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:57.574 [2024-04-26 18:04:48.640410] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:57.574 [2024-04-26 18:04:48.640436] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.574 [2024-04-26 18:04:48.640449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:48.640464] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.574 [2024-04-26 18:04:48.640474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:48.640486] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.574 [2024-04-26 18:04:48.640496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:48.640505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:17:57.574 [2024-04-26 18:04:48.640514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32564 cdw0:16 sqhd:43b9 p:0 m:0 dnr:0 00:17:57.574 [2024-04-26 18:04:48.642273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.574 [2024-04-26 18:04:48.642288] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.574 [2024-04-26 18:04:48.642313] rdma_verbs.c: 113:spdk_rdma_qp_disconnect: *ERROR*: rdma_disconnect failed, errno Invalid argument (22) 00:17:57.574 [2024-04-26 18:04:48.650425] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.660447] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.670471] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.680497] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.690522] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.700548] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.710575] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.720600] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.730627] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.574 [2024-04-26 18:04:48.740654] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.750680] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.760705] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.770729] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.780754] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.790780] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.800805] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.810831] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.820859] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.830891] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.840917] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.850949] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.860974] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.871003] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.881029] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.891053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.901081] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.911107] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.921132] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.931158] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.941186] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.951212] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.961239] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.971266] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.981292] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:48.991316] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.001349] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.011374] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.021400] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.031426] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.041452] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.051480] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.061504] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.071531] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.081558] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.091586] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.101613] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.111638] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.121663] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.131689] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.141713] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.151740] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.161767] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.171792] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.181820] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.191845] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.201870] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.211895] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.221921] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.231948] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.241974] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.252000] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.262026] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.272053] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.282077] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.292102] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.302128] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.312154] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.322182] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.332207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.342233] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.352260] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.362286] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.372312] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.382344] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.392366] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.402392] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.412419] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.422445] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.432471] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.442496] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.452522] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.462550] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.472576] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.482604] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.492630] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.502656] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.512683] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.522709] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.532735] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.542759] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.552785] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.563207] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.574025] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.584280] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.595569] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.605594] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.616212] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.626688] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.637012] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:17:57.575 [2024-04-26 18:04:49.644766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:15312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:15328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:15336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:15344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:15352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:17:57.576 [2024-04-26 18:04:49.644900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:14336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007900000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.644920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:14344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007902000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.644941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:14352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007904000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.644961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:14360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007906000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.644982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.644993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:14368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007908000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790a000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:14384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790c000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:14392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000790e000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007910000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007912000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:14416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007914000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:14424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007916000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:14432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007918000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:14440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791a000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:14448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791c000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:14456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000791e000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:14464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007920000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007922000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:14480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007924000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:14488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007926000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:14496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007928000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792a000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792c000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:14520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000792e000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007930000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:14536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007932000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:14544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007934000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:14552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007936000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:14560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007938000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:14568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793a000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.576 [2024-04-26 18:04:49.645525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:14576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793c000 len:0x1000 key:0x1bf0ef 00:17:57.576 [2024-04-26 18:04:49.645534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:14584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000793e000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:14592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007940000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:14600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007942000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:14608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007944000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:14616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007946000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:14624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007948000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:14632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794a000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794c000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:14648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000794e000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007950000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:14664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007952000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:14672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007954000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:14680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007956000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:14688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007958000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:14696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795a000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:14704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795c000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:14712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000795e000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:14720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007960000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:14728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007962000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:14736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007964000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:14744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007966000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.645987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007968000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.645997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:14760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796a000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:14768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796c000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:14776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000796e000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:14784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007970000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:14792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007972000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:14800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007974000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:14808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007976000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:14816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007978000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:14824 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797a000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14832 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797c000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:14840 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000797e000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:14848 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007980000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:14856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007982000 len:0x1000 key:0x1bf0ef 00:17:57.577 [2024-04-26 18:04:49.646262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.577 [2024-04-26 18:04:49.646273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:14864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007984000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:14872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007986000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:14880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007988000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:14888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798a000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:14896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798c000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:14904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000798e000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:14912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007990000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:14920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007992000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007994000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007996000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:14944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007998000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:14952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799a000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:14960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799c000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000799e000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:14976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a0000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:14984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a2000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a4000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a6000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:15008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079a8000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:15016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079aa000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:15024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ac000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:15032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ae000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:15040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b0000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:15048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b2000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:15056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b4000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:15064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b6000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:15072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079b8000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:15080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ba000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:15088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079bc000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:15096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079be000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:15104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c0000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.578 [2024-04-26 18:04:49.646903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:15112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c2000 len:0x1000 key:0x1bf0ef 00:17:57.578 [2024-04-26 18:04:49.646912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.646923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:15120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c4000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.646933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.646945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:15128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c6000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.646954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.646964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079c8000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.646973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.646984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:15144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ca000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.646994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:15152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079cc000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ce000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:15168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d0000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:15176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d2000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:15184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d4000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:15192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d6000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:15200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079d8000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:15208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079da000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:15216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079dc000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:15224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079de000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:15232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e0000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e2000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:15248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e4000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:15256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e6000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:15264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079e8000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:15272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ea000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.647325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:15280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ec000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.647334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.656426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:15288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079ee000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.656438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.656449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000079f0000 len:0x1000 key:0x1bf0ef 00:17:57.579 [2024-04-26 18:04:49.656458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32564 cdw0:3f0fd7e0 sqhd:1530 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.669445] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:17:57.579 [2024-04-26 18:04:49.669462] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:17:57.579 [2024-04-26 18:04:49.669471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15304 len:8 PRP1 0x0 PRP2 0x0 00:17:57.579 [2024-04-26 18:04:49.669481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:57.579 [2024-04-26 18:04:49.669532] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.579 [2024-04-26 18:04:49.672658] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.579 [2024-04-26 18:04:49.672677] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.579 [2024-04-26 18:04:49.672686] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.579 [2024-04-26 18:04:49.672706] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.579 [2024-04-26 18:04:49.672717] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.579 [2024-04-26 18:04:49.672748] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.579 [2024-04-26 18:04:49.672758] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.579 [2024-04-26 18:04:49.672768] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.579 [2024-04-26 18:04:49.672789] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.579 [2024-04-26 18:04:49.672798] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.579 [2024-04-26 18:04:50.675970] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.579 [2024-04-26 18:04:50.676018] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.579 [2024-04-26 18:04:50.676029] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.579 [2024-04-26 18:04:50.676052] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.579 [2024-04-26 18:04:50.676064] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.579 [2024-04-26 18:04:50.676077] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.579 [2024-04-26 18:04:50.676087] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.579 [2024-04-26 18:04:50.676099] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.579 [2024-04-26 18:04:50.676125] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.579 [2024-04-26 18:04:50.676135] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.579 [2024-04-26 18:04:51.680188] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ADDR_RESOLVED but received RDMA_CM_EVENT_ADDR_ERROR (1) from CM event channel (status = -19) 00:17:57.579 [2024-04-26 18:04:51.680227] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.579 [2024-04-26 18:04:51.680237] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.579 [2024-04-26 18:04:51.680262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.579 [2024-04-26 18:04:51.680273] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.579 [2024-04-26 18:04:51.680301] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.579 [2024-04-26 18:04:51.680311] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.580 [2024-04-26 18:04:51.680321] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.580 [2024-04-26 18:04:51.680354] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.580 [2024-04-26 18:04:51.680365] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.580 [2024-04-26 18:04:53.686677] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.580 [2024-04-26 18:04:53.686720] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.580 [2024-04-26 18:04:53.686749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.580 [2024-04-26 18:04:53.686760] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.580 [2024-04-26 18:04:53.686784] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.580 [2024-04-26 18:04:53.686793] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.580 [2024-04-26 18:04:53.686805] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.580 [2024-04-26 18:04:53.686845] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.580 [2024-04-26 18:04:53.686855] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.580 [2024-04-26 18:04:55.692584] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.580 [2024-04-26 18:04:55.692625] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.580 [2024-04-26 18:04:55.692658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.580 [2024-04-26 18:04:55.692669] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.580 [2024-04-26 18:04:55.694232] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.580 [2024-04-26 18:04:55.694251] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.580 [2024-04-26 18:04:55.694263] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.580 [2024-04-26 18:04:55.694286] bdev_nvme.c:2872:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Reset is already in progress. Defer failover until reset completes. 00:17:57.580 [2024-04-26 18:04:55.694652] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.580 [2024-04-26 18:04:55.694702] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.580 [2024-04-26 18:04:56.698034] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.580 [2024-04-26 18:04:56.698076] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.580 [2024-04-26 18:04:56.698105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.580 [2024-04-26 18:04:56.698117] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.580 [2024-04-26 18:04:56.698814] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.580 [2024-04-26 18:04:56.698826] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.580 [2024-04-26 18:04:56.698841] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.580 [2024-04-26 18:04:56.698884] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.580 [2024-04-26 18:04:56.698893] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.580 [2024-04-26 18:04:58.703934] nvme_rdma.c:1085:nvme_rdma_addr_resolved: *ERROR*: RDMA address resolution error 00:17:57.580 [2024-04-26 18:04:58.703967] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e4300 00:17:57.580 [2024-04-26 18:04:58.703998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:17:57.580 [2024-04-26 18:04:58.704012] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] in failed state. 00:17:57.580 [2024-04-26 18:04:58.704026] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] Ctrlr is in error state 00:17:57.580 [2024-04-26 18:04:58.704037] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:system_mlx_0_1] controller reinitialization failed 00:17:57.580 [2024-04-26 18:04:58.704049] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] already in failed state 00:17:57.580 [2024-04-26 18:04:58.704076] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:17:57.580 [2024-04-26 18:04:58.704087] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:system_mlx_0_1] resetting controller 00:17:57.580 [2024-04-26 18:04:59.761464] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:57.580 00:17:57.580 Latency(us) 00:17:57.580 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.580 Job: Nvme_mlx_0_0n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:57.580 Verification LBA range: start 0x0 length 0x8000 00:17:57.580 Nvme_mlx_0_0n1 : 90.01 10972.32 42.86 0.00 0.00 11648.13 2037.31 11087551.44 00:17:57.580 Job: Nvme_mlx_0_1n1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:57.580 Verification LBA range: start 0x0 length 0x8000 00:17:57.580 Nvme_mlx_0_1n1 : 90.01 9436.66 36.86 0.00 0.00 13543.20 2393.49 12079595.52 00:17:57.580 =================================================================================================================== 00:17:57.580 Total : 20408.98 79.72 0.00 0.00 12524.37 2037.31 12079595.52 00:17:57.580 Received shutdown signal, test time was about 90.000000 seconds 00:17:57.580 00:17:57.580 Latency(us) 00:17:57.580 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:57.580 =================================================================================================================== 00:17:57.580 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:57.580 18:06:03 -- target/device_removal.sh@123 -- # trap - SIGINT SIGTERM EXIT 00:17:57.580 18:06:03 -- target/device_removal.sh@124 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/try.txt 00:17:57.580 18:06:04 -- target/device_removal.sh@202 -- # killprocess 976845 00:17:57.580 18:06:04 -- common/autotest_common.sh@946 -- # '[' -z 976845 ']' 00:17:57.580 18:06:04 -- common/autotest_common.sh@950 -- # kill -0 976845 00:17:57.580 18:06:04 -- common/autotest_common.sh@951 -- # uname 00:17:57.580 18:06:04 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:17:57.580 18:06:04 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 976845 00:17:57.580 18:06:04 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:17:57.580 18:06:04 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:17:57.580 18:06:04 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 976845' 00:17:57.580 killing process with pid 976845 00:17:57.580 18:06:04 -- common/autotest_common.sh@965 -- # kill 976845 00:17:57.580 18:06:04 -- common/autotest_common.sh@970 -- # wait 976845 00:17:57.580 [2024-04-26 18:06:04.116114] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:17:57.580 18:06:04 -- target/device_removal.sh@203 -- # nvmfpid= 00:17:57.580 18:06:04 -- target/device_removal.sh@205 -- # return 0 00:17:57.580 00:17:57.580 real 1m33.437s 00:17:57.580 user 4m25.834s 00:17:57.580 sys 0m4.609s 00:17:57.580 18:06:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:17:57.580 18:06:04 -- common/autotest_common.sh@10 -- # set +x 00:17:57.580 ************************************ 00:17:57.580 END TEST nvmf_device_removal_pci_remove 00:17:57.580 ************************************ 00:17:57.580 18:06:04 -- target/device_removal.sh@317 -- # nvmftestfini 00:17:57.580 18:06:04 -- nvmf/common.sh@477 -- # nvmfcleanup 00:17:57.580 18:06:04 -- nvmf/common.sh@117 -- # sync 00:17:57.580 18:06:04 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:17:57.580 18:06:04 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:17:57.580 18:06:04 -- nvmf/common.sh@120 -- # set +e 00:17:57.580 18:06:04 -- nvmf/common.sh@121 -- # for i in {1..20} 00:17:57.580 18:06:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:17:57.580 rmmod nvme_rdma 00:17:57.580 rmmod nvme_fabrics 00:17:57.580 18:06:04 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:17:57.580 18:06:04 -- nvmf/common.sh@124 -- # set -e 00:17:57.580 18:06:04 -- nvmf/common.sh@125 -- # return 0 00:17:57.580 18:06:04 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:17:57.580 18:06:04 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:17:57.580 18:06:04 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:17:57.580 18:06:04 -- target/device_removal.sh@318 -- # clean_bond_device 00:17:57.580 18:06:04 -- target/device_removal.sh@240 -- # ip link 00:17:57.580 18:06:04 -- target/device_removal.sh@240 -- # grep bond_nvmf 00:17:57.580 00:17:57.580 real 3m13.813s 00:17:57.580 user 8m53.257s 00:17:57.580 sys 0m14.440s 00:17:57.580 18:06:04 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:17:57.580 18:06:04 -- common/autotest_common.sh@10 -- # set +x 00:17:57.580 ************************************ 00:17:57.580 END TEST nvmf_device_removal 00:17:57.580 ************************************ 00:17:57.580 18:06:04 -- nvmf/nvmf.sh@79 -- # run_test nvmf_srq_overwhelm /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:17:57.580 18:06:04 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:17:57.580 18:06:04 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:17:57.580 18:06:04 -- common/autotest_common.sh@10 -- # set +x 00:17:57.580 ************************************ 00:17:57.580 START TEST nvmf_srq_overwhelm 00:17:57.580 ************************************ 00:17:57.580 18:06:04 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/srq_overwhelm.sh --transport=rdma 00:17:57.580 * Looking for test storage... 00:17:57.580 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:17:57.580 18:06:04 -- target/srq_overwhelm.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:17:57.580 18:06:04 -- nvmf/common.sh@7 -- # uname -s 00:17:57.580 18:06:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:57.580 18:06:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:57.580 18:06:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:57.580 18:06:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:57.580 18:06:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:57.580 18:06:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:57.580 18:06:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:57.581 18:06:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:57.581 18:06:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:57.581 18:06:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:57.581 18:06:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:17:57.581 18:06:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:17:57.581 18:06:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:57.581 18:06:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:57.581 18:06:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:57.581 18:06:04 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:17:57.581 18:06:04 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:17:57.581 18:06:04 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:57.581 18:06:04 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:57.581 18:06:04 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:57.581 18:06:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.581 18:06:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.581 18:06:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.581 18:06:04 -- paths/export.sh@5 -- # export PATH 00:17:57.581 18:06:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:57.581 18:06:04 -- nvmf/common.sh@47 -- # : 0 00:17:57.581 18:06:04 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:17:57.581 18:06:04 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:17:57.581 18:06:04 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:17:57.581 18:06:04 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:57.581 18:06:04 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:57.581 18:06:04 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:17:57.581 18:06:04 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:17:57.581 18:06:04 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:17:57.581 18:06:04 -- target/srq_overwhelm.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:57.581 18:06:04 -- target/srq_overwhelm.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:57.581 18:06:04 -- target/srq_overwhelm.sh@13 -- # NVME_CONNECT='nvme connect -i 16' 00:17:57.581 18:06:04 -- target/srq_overwhelm.sh@15 -- # nvmftestinit 00:17:57.581 18:06:04 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:17:57.581 18:06:04 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:57.581 18:06:04 -- nvmf/common.sh@437 -- # prepare_net_devs 00:17:57.581 18:06:04 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:17:57.581 18:06:04 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:17:57.581 18:06:04 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:57.581 18:06:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:57.581 18:06:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:57.581 18:06:04 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:17:57.581 18:06:04 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:17:57.581 18:06:04 -- nvmf/common.sh@285 -- # xtrace_disable 00:17:57.581 18:06:04 -- common/autotest_common.sh@10 -- # set +x 00:18:00.871 18:06:10 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:00.871 18:06:10 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:00.871 18:06:10 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:00.871 18:06:10 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:00.871 18:06:10 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:00.871 18:06:10 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:00.871 18:06:10 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:00.871 18:06:10 -- nvmf/common.sh@295 -- # net_devs=() 00:18:00.871 18:06:10 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:00.871 18:06:10 -- nvmf/common.sh@296 -- # e810=() 00:18:00.871 18:06:10 -- nvmf/common.sh@296 -- # local -ga e810 00:18:00.871 18:06:10 -- nvmf/common.sh@297 -- # x722=() 00:18:00.871 18:06:10 -- nvmf/common.sh@297 -- # local -ga x722 00:18:01.131 18:06:10 -- nvmf/common.sh@298 -- # mlx=() 00:18:01.131 18:06:10 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:01.131 18:06:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:01.131 18:06:10 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:01.131 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:01.131 18:06:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:01.131 18:06:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:01.131 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:01.131 18:06:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:01.131 18:06:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:01.131 18:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:01.131 18:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:01.131 Found net devices under 0000:18:00.0: mlx_0_0 00:18:01.131 18:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:01.131 18:06:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:01.131 18:06:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:01.131 Found net devices under 0000:18:00.1: mlx_0_1 00:18:01.131 18:06:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:01.131 18:06:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:01.131 18:06:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:01.131 18:06:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:01.131 18:06:10 -- nvmf/common.sh@58 -- # uname 00:18:01.131 18:06:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:01.131 18:06:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:01.131 18:06:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:01.131 18:06:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:01.131 18:06:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:01.131 18:06:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:01.131 18:06:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:01.131 18:06:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:01.131 18:06:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:01.131 18:06:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:01.131 18:06:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:01.131 18:06:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:01.131 18:06:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:01.131 18:06:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:01.131 18:06:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:01.131 18:06:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:01.131 18:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:01.131 18:06:10 -- nvmf/common.sh@105 -- # continue 2 00:18:01.131 18:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.131 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:01.131 18:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:01.131 18:06:10 -- nvmf/common.sh@105 -- # continue 2 00:18:01.131 18:06:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:01.131 18:06:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:01.131 18:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:01.131 18:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:01.132 18:06:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:01.132 18:06:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:01.132 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:01.132 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:18:01.132 altname enp24s0f0np0 00:18:01.132 altname ens785f0np0 00:18:01.132 inet 192.168.100.8/24 scope global mlx_0_0 00:18:01.132 valid_lft forever preferred_lft forever 00:18:01.132 18:06:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:01.132 18:06:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:01.132 18:06:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:01.132 18:06:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:01.132 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:01.132 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:18:01.132 altname enp24s0f1np1 00:18:01.132 altname ens785f1np1 00:18:01.132 inet 192.168.100.9/24 scope global mlx_0_1 00:18:01.132 valid_lft forever preferred_lft forever 00:18:01.132 18:06:10 -- nvmf/common.sh@411 -- # return 0 00:18:01.132 18:06:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:01.132 18:06:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:01.132 18:06:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:01.132 18:06:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:01.132 18:06:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:01.132 18:06:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:01.132 18:06:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:01.132 18:06:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:01.132 18:06:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:01.132 18:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:01.132 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.132 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:01.132 18:06:10 -- nvmf/common.sh@105 -- # continue 2 00:18:01.132 18:06:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:01.132 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.132 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:01.132 18:06:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:01.132 18:06:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@105 -- # continue 2 00:18:01.132 18:06:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:01.132 18:06:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:01.132 18:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:01.132 18:06:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:01.132 18:06:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:01.132 18:06:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:01.132 18:06:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:01.132 192.168.100.9' 00:18:01.132 18:06:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:01.132 192.168.100.9' 00:18:01.132 18:06:10 -- nvmf/common.sh@446 -- # head -n 1 00:18:01.132 18:06:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:01.132 18:06:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:01.132 192.168.100.9' 00:18:01.132 18:06:10 -- nvmf/common.sh@447 -- # tail -n +2 00:18:01.132 18:06:10 -- nvmf/common.sh@447 -- # head -n 1 00:18:01.132 18:06:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:01.132 18:06:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:01.132 18:06:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:01.132 18:06:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:01.132 18:06:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:01.132 18:06:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:01.132 18:06:10 -- target/srq_overwhelm.sh@17 -- # nvmfappstart -m 0xF 00:18:01.132 18:06:10 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:01.132 18:06:10 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:01.132 18:06:10 -- common/autotest_common.sh@10 -- # set +x 00:18:01.132 18:06:10 -- nvmf/common.sh@470 -- # nvmfpid=992600 00:18:01.132 18:06:10 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:01.132 18:06:10 -- nvmf/common.sh@471 -- # waitforlisten 992600 00:18:01.132 18:06:10 -- common/autotest_common.sh@827 -- # '[' -z 992600 ']' 00:18:01.132 18:06:10 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:01.132 18:06:10 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:01.132 18:06:10 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:01.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:01.132 18:06:10 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:01.132 18:06:10 -- common/autotest_common.sh@10 -- # set +x 00:18:01.392 [2024-04-26 18:06:10.343830] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:01.392 [2024-04-26 18:06:10.343892] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:01.392 EAL: No free 2048 kB hugepages reported on node 1 00:18:01.392 [2024-04-26 18:06:10.413714] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:01.392 [2024-04-26 18:06:10.501564] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:01.392 [2024-04-26 18:06:10.501613] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:01.392 [2024-04-26 18:06:10.501623] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:01.392 [2024-04-26 18:06:10.501632] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:01.392 [2024-04-26 18:06:10.501639] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:01.392 [2024-04-26 18:06:10.501715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:01.392 [2024-04-26 18:06:10.501781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:01.392 [2024-04-26 18:06:10.501859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:01.392 [2024-04-26 18:06:10.501860] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:02.330 18:06:11 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:02.330 18:06:11 -- common/autotest_common.sh@860 -- # return 0 00:18:02.330 18:06:11 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:02.330 18:06:11 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 18:06:11 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 -s 1024 00:18:02.330 18:06:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 [2024-04-26 18:06:11.235636] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x238d4d0/0x23919c0) succeed. 00:18:02.330 [2024-04-26 18:06:11.246130] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x238eb10/0x23d3050) succeed. 00:18:02.330 18:06:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@22 -- # seq 0 5 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000000 00:18:02.330 18:06:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 18:06:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:02.330 18:06:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 Malloc0 00:18:02.330 18:06:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:18:02.330 18:06:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 18:06:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:18:02.330 18:06:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:02.330 18:06:11 -- common/autotest_common.sh@10 -- # set +x 00:18:02.330 [2024-04-26 18:06:11.349928] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:02.330 18:06:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:02.330 18:06:11 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode0 -a 192.168.100.8 -s 4420 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme0n1 00:18:03.267 18:06:12 -- common/autotest_common.sh@1231 -- # local i=0 00:18:03.267 18:06:12 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:03.267 18:06:12 -- common/autotest_common.sh@1232 -- # grep -q -w nvme0n1 00:18:03.267 18:06:12 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:03.267 18:06:12 -- common/autotest_common.sh@1238 -- # grep -q -w nvme0n1 00:18:03.267 18:06:12 -- common/autotest_common.sh@1242 -- # return 0 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:03.267 18:06:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:03.267 18:06:12 -- common/autotest_common.sh@10 -- # set +x 00:18:03.267 18:06:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:18:03.267 18:06:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:03.267 18:06:12 -- common/autotest_common.sh@10 -- # set +x 00:18:03.267 Malloc1 00:18:03.267 18:06:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:18:03.267 18:06:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:03.267 18:06:12 -- common/autotest_common.sh@10 -- # set +x 00:18:03.267 18:06:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:18:03.267 18:06:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:03.267 18:06:12 -- common/autotest_common.sh@10 -- # set +x 00:18:03.267 18:06:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:03.267 18:06:12 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode1 -a 192.168.100.8 -s 4420 00:18:04.201 18:06:13 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme1n1 00:18:04.201 18:06:13 -- common/autotest_common.sh@1231 -- # local i=0 00:18:04.201 18:06:13 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:04.201 18:06:13 -- common/autotest_common.sh@1232 -- # grep -q -w nvme1n1 00:18:04.459 18:06:13 -- common/autotest_common.sh@1238 -- # grep -q -w nvme1n1 00:18:04.459 18:06:13 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:04.459 18:06:13 -- common/autotest_common.sh@1242 -- # return 0 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:18:04.459 18:06:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:04.459 18:06:13 -- common/autotest_common.sh@10 -- # set +x 00:18:04.459 18:06:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:18:04.459 18:06:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:04.459 18:06:13 -- common/autotest_common.sh@10 -- # set +x 00:18:04.459 Malloc2 00:18:04.459 18:06:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:18:04.459 18:06:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:04.459 18:06:13 -- common/autotest_common.sh@10 -- # set +x 00:18:04.459 18:06:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t rdma -a 192.168.100.8 -s 4420 00:18:04.459 18:06:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:04.459 18:06:13 -- common/autotest_common.sh@10 -- # set +x 00:18:04.459 18:06:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:04.459 18:06:13 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode2 -a 192.168.100.8 -s 4420 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme2n1 00:18:05.395 18:06:14 -- common/autotest_common.sh@1231 -- # local i=0 00:18:05.395 18:06:14 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:05.395 18:06:14 -- common/autotest_common.sh@1232 -- # grep -q -w nvme2n1 00:18:05.395 18:06:14 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:05.395 18:06:14 -- common/autotest_common.sh@1238 -- # grep -q -w nvme2n1 00:18:05.395 18:06:14 -- common/autotest_common.sh@1242 -- # return 0 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:18:05.395 18:06:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:05.395 18:06:14 -- common/autotest_common.sh@10 -- # set +x 00:18:05.395 18:06:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:18:05.395 18:06:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:05.395 18:06:14 -- common/autotest_common.sh@10 -- # set +x 00:18:05.395 Malloc3 00:18:05.395 18:06:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:18:05.395 18:06:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:05.395 18:06:14 -- common/autotest_common.sh@10 -- # set +x 00:18:05.395 18:06:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t rdma -a 192.168.100.8 -s 4420 00:18:05.395 18:06:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:05.395 18:06:14 -- common/autotest_common.sh@10 -- # set +x 00:18:05.395 18:06:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:05.395 18:06:14 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode3 -a 192.168.100.8 -s 4420 00:18:06.331 18:06:15 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme3n1 00:18:06.331 18:06:15 -- common/autotest_common.sh@1231 -- # local i=0 00:18:06.331 18:06:15 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:06.331 18:06:15 -- common/autotest_common.sh@1232 -- # grep -q -w nvme3n1 00:18:06.331 18:06:15 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:06.331 18:06:15 -- common/autotest_common.sh@1238 -- # grep -q -w nvme3n1 00:18:06.331 18:06:15 -- common/autotest_common.sh@1242 -- # return 0 00:18:06.331 18:06:15 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:06.331 18:06:15 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:18:06.331 18:06:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:06.331 18:06:15 -- common/autotest_common.sh@10 -- # set +x 00:18:06.331 18:06:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:06.331 18:06:15 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:18:06.331 18:06:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:06.331 18:06:15 -- common/autotest_common.sh@10 -- # set +x 00:18:06.590 Malloc4 00:18:06.590 18:06:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:06.590 18:06:15 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:18:06.590 18:06:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:06.590 18:06:15 -- common/autotest_common.sh@10 -- # set +x 00:18:06.590 18:06:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:06.590 18:06:15 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t rdma -a 192.168.100.8 -s 4420 00:18:06.590 18:06:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:06.590 18:06:15 -- common/autotest_common.sh@10 -- # set +x 00:18:06.590 18:06:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:06.590 18:06:15 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode4 -a 192.168.100.8 -s 4420 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme4n1 00:18:07.527 18:06:16 -- common/autotest_common.sh@1231 -- # local i=0 00:18:07.527 18:06:16 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:07.527 18:06:16 -- common/autotest_common.sh@1232 -- # grep -q -w nvme4n1 00:18:07.527 18:06:16 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:07.527 18:06:16 -- common/autotest_common.sh@1238 -- # grep -q -w nvme4n1 00:18:07.527 18:06:16 -- common/autotest_common.sh@1242 -- # return 0 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@22 -- # for i in $(seq 0 5) 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK00000000000005 00:18:07.527 18:06:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:07.527 18:06:16 -- common/autotest_common.sh@10 -- # set +x 00:18:07.527 18:06:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:18:07.527 18:06:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:07.527 18:06:16 -- common/autotest_common.sh@10 -- # set +x 00:18:07.527 Malloc5 00:18:07.527 18:06:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:18:07.527 18:06:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:07.527 18:06:16 -- common/autotest_common.sh@10 -- # set +x 00:18:07.527 18:06:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t rdma -a 192.168.100.8 -s 4420 00:18:07.527 18:06:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:07.527 18:06:16 -- common/autotest_common.sh@10 -- # set +x 00:18:07.527 18:06:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:07.527 18:06:16 -- target/srq_overwhelm.sh@27 -- # nvme connect -i 15 --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -t rdma -n nqn.2016-06.io.spdk:cnode5 -a 192.168.100.8 -s 4420 00:18:08.463 18:06:17 -- target/srq_overwhelm.sh@28 -- # waitforblk nvme5n1 00:18:08.463 18:06:17 -- common/autotest_common.sh@1231 -- # local i=0 00:18:08.463 18:06:17 -- common/autotest_common.sh@1232 -- # lsblk -l -o NAME 00:18:08.463 18:06:17 -- common/autotest_common.sh@1232 -- # grep -q -w nvme5n1 00:18:08.463 18:06:17 -- common/autotest_common.sh@1238 -- # grep -q -w nvme5n1 00:18:08.463 18:06:17 -- common/autotest_common.sh@1238 -- # lsblk -l -o NAME 00:18:08.463 18:06:17 -- common/autotest_common.sh@1242 -- # return 0 00:18:08.463 18:06:17 -- target/srq_overwhelm.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 1048576 -d 128 -t read -r 10 -n 13 00:18:08.463 [global] 00:18:08.463 thread=1 00:18:08.463 invalidate=1 00:18:08.463 rw=read 00:18:08.463 time_based=1 00:18:08.463 runtime=10 00:18:08.463 ioengine=libaio 00:18:08.463 direct=1 00:18:08.463 bs=1048576 00:18:08.463 iodepth=128 00:18:08.463 norandommap=1 00:18:08.463 numjobs=13 00:18:08.463 00:18:08.463 [job0] 00:18:08.463 filename=/dev/nvme0n1 00:18:08.463 [job1] 00:18:08.463 filename=/dev/nvme1n1 00:18:08.463 [job2] 00:18:08.464 filename=/dev/nvme2n1 00:18:08.464 [job3] 00:18:08.464 filename=/dev/nvme3n1 00:18:08.464 [job4] 00:18:08.464 filename=/dev/nvme4n1 00:18:08.464 [job5] 00:18:08.464 filename=/dev/nvme5n1 00:18:08.722 Could not set queue depth (nvme0n1) 00:18:08.722 Could not set queue depth (nvme1n1) 00:18:08.722 Could not set queue depth (nvme2n1) 00:18:08.722 Could not set queue depth (nvme3n1) 00:18:08.722 Could not set queue depth (nvme4n1) 00:18:08.722 Could not set queue depth (nvme5n1) 00:18:08.988 job0: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 job1: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 job2: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 job3: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 job4: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 job5: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=128 00:18:08.988 ... 00:18:08.988 fio-3.35 00:18:08.988 Starting 78 threads 00:18:23.954 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993745: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=37, BW=37.2MiB/s (39.1MB/s)(376MiB/10094msec) 00:18:23.954 slat (usec): min=102, max=2071.5k, avg=26592.15, stdev=150153.90 00:18:23.954 clat (msec): min=92, max=5460, avg=2861.33, stdev=1516.01 00:18:23.954 lat (msec): min=95, max=5463, avg=2887.92, stdev=1516.52 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 180], 5.00th=[ 326], 10.00th=[ 651], 20.00th=[ 1250], 00:18:23.954 | 30.00th=[ 1670], 40.00th=[ 1905], 50.00th=[ 3742], 60.00th=[ 3876], 00:18:23.954 | 70.00th=[ 3977], 80.00th=[ 4329], 90.00th=[ 4396], 95.00th=[ 4463], 00:18:23.954 | 99.00th=[ 5403], 99.50th=[ 5470], 99.90th=[ 5470], 99.95th=[ 5470], 00:18:23.954 | 99.99th=[ 5470] 00:18:23.954 bw ( KiB/s): min= 4104, max=86016, per=1.75%, avg=56466.89, stdev=28473.18, samples=9 00:18:23.954 iops : min= 4, max= 84, avg=55.11, stdev=27.79, samples=9 00:18:23.954 lat (msec) : 100=0.53%, 250=2.39%, 500=3.99%, 750=4.79%, 1000=4.52% 00:18:23.954 lat (msec) : 2000=25.80%, >=2000=57.98% 00:18:23.954 cpu : usr=0.00%, sys=1.31%, ctx=863, majf=0, minf=32769 00:18:23.954 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.1%, 16=4.3%, 32=8.5%, >=64=83.2% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:23.954 issued rwts: total=376,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993746: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=61, BW=61.2MiB/s (64.2MB/s)(616MiB/10066msec) 00:18:23.954 slat (usec): min=42, max=2088.8k, avg=16234.67, stdev=117323.47 00:18:23.954 clat (msec): min=62, max=5287, avg=1472.23, stdev=1279.14 00:18:23.954 lat (msec): min=73, max=5293, avg=1488.47, stdev=1288.40 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 123], 5.00th=[ 317], 10.00th=[ 380], 20.00th=[ 426], 00:18:23.954 | 30.00th=[ 592], 40.00th=[ 743], 50.00th=[ 1116], 60.00th=[ 1368], 00:18:23.954 | 70.00th=[ 1603], 80.00th=[ 2433], 90.00th=[ 3004], 95.00th=[ 4933], 00:18:23.954 | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:18:23.954 | 99.99th=[ 5269] 00:18:23.954 bw ( KiB/s): min=24576, max=311296, per=3.46%, avg=111260.56, stdev=84512.26, samples=9 00:18:23.954 iops : min= 24, max= 304, avg=108.56, stdev=82.59, samples=9 00:18:23.954 lat (msec) : 100=0.32%, 250=3.08%, 500=18.99%, 750=18.51%, 1000=6.01% 00:18:23.954 lat (msec) : 2000=27.76%, >=2000=25.32% 00:18:23.954 cpu : usr=0.04%, sys=1.41%, ctx=1026, majf=0, minf=32769 00:18:23.954 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.3%, 16=2.6%, 32=5.2%, >=64=89.8% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.954 issued rwts: total=616,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993747: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=6, BW=6801KiB/s (6964kB/s)(67.0MiB/10088msec) 00:18:23.954 slat (usec): min=494, max=2091.8k, avg=150265.73, stdev=514526.95 00:18:23.954 clat (msec): min=19, max=10087, avg=6178.47, stdev=3018.22 00:18:23.954 lat (msec): min=2076, max=10087, avg=6328.74, stdev=2956.97 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 21], 5.00th=[ 2089], 10.00th=[ 2089], 20.00th=[ 2140], 00:18:23.954 | 30.00th=[ 4245], 40.00th=[ 6275], 50.00th=[ 6409], 60.00th=[ 6409], 00:18:23.954 | 70.00th=[ 8557], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:18:23.954 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:18:23.954 | 99.99th=[10134] 00:18:23.954 lat (msec) : 20=1.49%, >=2000=98.51% 00:18:23.954 cpu : usr=0.00%, sys=0.51%, ctx=59, majf=0, minf=17153 00:18:23.954 IO depths : 1=1.5%, 2=3.0%, 4=6.0%, 8=11.9%, 16=23.9%, 32=47.8%, >=64=6.0% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.954 issued rwts: total=67,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993748: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=45, BW=45.8MiB/s (48.1MB/s)(558MiB/12175msec) 00:18:23.954 slat (usec): min=45, max=2113.3k, avg=18016.73, stdev=155572.85 00:18:23.954 clat (msec): min=124, max=6211, avg=1916.48, stdev=2293.49 00:18:23.954 lat (msec): min=125, max=6264, avg=1934.50, stdev=2300.20 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 126], 5.00th=[ 134], 10.00th=[ 215], 20.00th=[ 535], 00:18:23.954 | 30.00th=[ 625], 40.00th=[ 667], 50.00th=[ 768], 60.00th=[ 818], 00:18:23.954 | 70.00th=[ 919], 80.00th=[ 6007], 90.00th=[ 6074], 95.00th=[ 6074], 00:18:23.954 | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6208], 99.95th=[ 6208], 00:18:23.954 | 99.99th=[ 6208] 00:18:23.954 bw ( KiB/s): min= 1577, max=327680, per=3.91%, avg=125983.00, stdev=118415.40, samples=7 00:18:23.954 iops : min= 1, max= 320, avg=122.86, stdev=115.70, samples=7 00:18:23.954 lat (msec) : 250=12.37%, 500=3.58%, 750=32.62%, 1000=26.34%, 2000=0.18% 00:18:23.954 lat (msec) : >=2000=24.91% 00:18:23.954 cpu : usr=0.04%, sys=0.86%, ctx=1338, majf=0, minf=32769 00:18:23.954 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.7% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.954 issued rwts: total=558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993749: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=53, BW=53.4MiB/s (56.0MB/s)(652MiB/12215msec) 00:18:23.954 slat (usec): min=47, max=2173.4k, avg=15501.52, stdev=128144.35 00:18:23.954 clat (msec): min=347, max=4870, avg=1702.79, stdev=1604.79 00:18:23.954 lat (msec): min=349, max=4874, avg=1718.30, stdev=1611.51 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 351], 5.00th=[ 359], 10.00th=[ 368], 20.00th=[ 422], 00:18:23.954 | 30.00th=[ 634], 40.00th=[ 802], 50.00th=[ 1150], 60.00th=[ 1284], 00:18:23.954 | 70.00th=[ 1401], 80.00th=[ 4396], 90.00th=[ 4597], 95.00th=[ 4597], 00:18:23.954 | 99.00th=[ 4799], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:18:23.954 | 99.99th=[ 4866] 00:18:23.954 bw ( KiB/s): min= 1526, max=294912, per=4.17%, avg=134227.88, stdev=105714.01, samples=8 00:18:23.954 iops : min= 1, max= 288, avg=130.88, stdev=103.22, samples=8 00:18:23.954 lat (msec) : 500=25.00%, 750=9.66%, 1000=12.88%, 2000=28.68%, >=2000=23.77% 00:18:23.954 cpu : usr=0.02%, sys=1.09%, ctx=1283, majf=0, minf=32769 00:18:23.954 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.3% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.954 issued rwts: total=652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993750: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=37, BW=37.5MiB/s (39.3MB/s)(378MiB/10073msec) 00:18:23.954 slat (usec): min=56, max=2112.6k, avg=26506.25, stdev=163674.33 00:18:23.954 clat (msec): min=51, max=4961, avg=2109.69, stdev=1417.24 00:18:23.954 lat (msec): min=89, max=4986, avg=2136.19, stdev=1427.77 00:18:23.954 clat percentiles (msec): 00:18:23.954 | 1.00th=[ 113], 5.00th=[ 247], 10.00th=[ 550], 20.00th=[ 944], 00:18:23.954 | 30.00th=[ 1133], 40.00th=[ 1217], 50.00th=[ 1301], 60.00th=[ 2106], 00:18:23.954 | 70.00th=[ 3742], 80.00th=[ 3809], 90.00th=[ 3910], 95.00th=[ 3977], 00:18:23.954 | 99.00th=[ 4732], 99.50th=[ 4799], 99.90th=[ 4933], 99.95th=[ 4933], 00:18:23.954 | 99.99th=[ 4933] 00:18:23.954 bw ( KiB/s): min= 2048, max=114688, per=1.94%, avg=62317.71, stdev=47940.37, samples=7 00:18:23.954 iops : min= 2, max= 112, avg=60.86, stdev=46.82, samples=7 00:18:23.954 lat (msec) : 100=0.79%, 250=4.23%, 500=4.76%, 750=3.70%, 1000=7.41% 00:18:23.954 lat (msec) : 2000=38.89%, >=2000=40.21% 00:18:23.954 cpu : usr=0.01%, sys=1.03%, ctx=561, majf=0, minf=32769 00:18:23.954 IO depths : 1=0.3%, 2=0.5%, 4=1.1%, 8=2.1%, 16=4.2%, 32=8.5%, >=64=83.3% 00:18:23.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.954 complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.4% 00:18:23.954 issued rwts: total=378,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.954 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.954 job0: (groupid=0, jobs=1): err= 0: pid=993751: Fri Apr 26 18:06:30 2024 00:18:23.954 read: IOPS=7, BW=7768KiB/s (7955kB/s)(93.0MiB/12259msec) 00:18:23.954 slat (usec): min=396, max=2103.1k, avg=108913.91, stdev=429676.05 00:18:23.955 clat (msec): min=2129, max=12256, avg=8478.74, stdev=3527.73 00:18:23.955 lat (msec): min=4150, max=12258, avg=8587.65, stdev=3485.68 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 2123], 5.00th=[ 4144], 10.00th=[ 4144], 20.00th=[ 4279], 00:18:23.955 | 30.00th=[ 6208], 40.00th=[ 6342], 50.00th=[ 8490], 60.00th=[11879], 00:18:23.955 | 70.00th=[12013], 80.00th=[12147], 90.00th=[12281], 95.00th=[12281], 00:18:23.955 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.955 | 99.99th=[12281] 00:18:23.955 lat (msec) : >=2000=100.00% 00:18:23.955 cpu : usr=0.01%, sys=0.57%, ctx=158, majf=0, minf=23809 00:18:23.955 IO depths : 1=1.1%, 2=2.2%, 4=4.3%, 8=8.6%, 16=17.2%, 32=34.4%, >=64=32.3% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.955 issued rwts: total=93,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993752: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=35, BW=35.6MiB/s (37.4MB/s)(436MiB/12233msec) 00:18:23.955 slat (usec): min=65, max=2082.6k, avg=23192.30, stdev=180936.30 00:18:23.955 clat (msec): min=421, max=7021, avg=2413.01, stdev=2750.66 00:18:23.955 lat (msec): min=423, max=7028, avg=2436.21, stdev=2757.99 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 422], 5.00th=[ 430], 10.00th=[ 447], 20.00th=[ 485], 00:18:23.955 | 30.00th=[ 523], 40.00th=[ 600], 50.00th=[ 625], 60.00th=[ 667], 00:18:23.955 | 70.00th=[ 4212], 80.00th=[ 6611], 90.00th=[ 6812], 95.00th=[ 6946], 00:18:23.955 | 99.00th=[ 7013], 99.50th=[ 7013], 99.90th=[ 7013], 99.95th=[ 7013], 00:18:23.955 | 99.99th=[ 7013] 00:18:23.955 bw ( KiB/s): min= 1526, max=288768, per=2.80%, avg=90268.57, stdev=119152.34, samples=7 00:18:23.955 iops : min= 1, max= 282, avg=88.00, stdev=116.32, samples=7 00:18:23.955 lat (msec) : 500=25.23%, 750=37.16%, 1000=5.28%, >=2000=32.34% 00:18:23.955 cpu : usr=0.03%, sys=0.74%, ctx=1132, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.7%, 32=7.3%, >=64=85.6% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.955 issued rwts: total=436,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993753: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=62, BW=62.9MiB/s (65.9MB/s)(768MiB/12213msec) 00:18:23.955 slat (usec): min=49, max=2123.6k, avg=13129.34, stdev=130480.80 00:18:23.955 clat (msec): min=502, max=9132, avg=1946.90, stdev=2998.44 00:18:23.955 lat (msec): min=504, max=9133, avg=1960.03, stdev=3007.84 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 506], 5.00th=[ 514], 10.00th=[ 518], 20.00th=[ 550], 00:18:23.955 | 30.00th=[ 575], 40.00th=[ 592], 50.00th=[ 609], 60.00th=[ 625], 00:18:23.955 | 70.00th=[ 651], 80.00th=[ 693], 90.00th=[ 8792], 95.00th=[ 8926], 00:18:23.955 | 99.00th=[ 9060], 99.50th=[ 9060], 99.90th=[ 9194], 99.95th=[ 9194], 00:18:23.955 | 99.99th=[ 9194] 00:18:23.955 bw ( KiB/s): min= 1526, max=249856, per=4.08%, avg=131224.60, stdev=98425.11, samples=10 00:18:23.955 iops : min= 1, max= 244, avg=128.10, stdev=96.19, samples=10 00:18:23.955 lat (msec) : 750=82.29%, >=2000=17.71% 00:18:23.955 cpu : usr=0.00%, sys=1.24%, ctx=690, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.2%, >=64=91.8% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.955 issued rwts: total=768,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993754: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=183, BW=183MiB/s (192MB/s)(2247MiB/12273msec) 00:18:23.955 slat (usec): min=40, max=2112.9k, avg=4512.98, stdev=60758.06 00:18:23.955 clat (msec): min=122, max=4437, avg=660.39, stdev=1108.01 00:18:23.955 lat (msec): min=122, max=4438, avg=664.91, stdev=1111.80 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 127], 5.00th=[ 128], 10.00th=[ 129], 20.00th=[ 129], 00:18:23.955 | 30.00th=[ 130], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 132], 00:18:23.955 | 70.00th=[ 514], 80.00th=[ 944], 90.00th=[ 2702], 95.00th=[ 4329], 00:18:23.955 | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4463], 99.95th=[ 4463], 00:18:23.955 | 99.99th=[ 4463] 00:18:23.955 bw ( KiB/s): min= 2048, max=1009664, per=10.38%, avg=334238.69, stdev=387155.42, samples=13 00:18:23.955 iops : min= 2, max= 986, avg=326.31, stdev=377.96, samples=13 00:18:23.955 lat (msec) : 250=68.36%, 500=0.98%, 750=6.85%, 1000=4.85%, 2000=7.61% 00:18:23.955 lat (msec) : >=2000=11.35% 00:18:23.955 cpu : usr=0.03%, sys=1.85%, ctx=2576, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.7%, 32=1.4%, >=64=97.2% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.955 issued rwts: total=2247,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993755: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=101, BW=101MiB/s (106MB/s)(1233MiB/12204msec) 00:18:23.955 slat (usec): min=54, max=2121.0k, avg=8180.04, stdev=61467.72 00:18:23.955 clat (msec): min=409, max=4716, avg=1217.60, stdev=1152.15 00:18:23.955 lat (msec): min=410, max=4719, avg=1225.78, stdev=1154.88 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 414], 5.00th=[ 435], 10.00th=[ 464], 20.00th=[ 558], 00:18:23.955 | 30.00th=[ 609], 40.00th=[ 651], 50.00th=[ 827], 60.00th=[ 894], 00:18:23.955 | 70.00th=[ 1167], 80.00th=[ 1452], 90.00th=[ 4279], 95.00th=[ 4463], 00:18:23.955 | 99.00th=[ 4597], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4732], 00:18:23.955 | 99.99th=[ 4732] 00:18:23.955 bw ( KiB/s): min= 1526, max=268288, per=4.40%, avg=141515.69, stdev=75226.27, samples=16 00:18:23.955 iops : min= 1, max= 262, avg=138.12, stdev=73.51, samples=16 00:18:23.955 lat (msec) : 500=15.65%, 750=28.55%, 1000=22.47%, 2000=22.95%, >=2000=10.38% 00:18:23.955 cpu : usr=0.04%, sys=1.70%, ctx=1774, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.1%, 2=0.2%, 4=0.3%, 8=0.6%, 16=1.3%, 32=2.6%, >=64=94.9% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.955 issued rwts: total=1233,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993756: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=43, BW=43.8MiB/s (45.9MB/s)(441MiB/10065msec) 00:18:23.955 slat (usec): min=83, max=2074.7k, avg=22711.19, stdev=154487.66 00:18:23.955 clat (msec): min=46, max=5026, avg=1714.14, stdev=1258.71 00:18:23.955 lat (msec): min=78, max=5029, avg=1736.85, stdev=1270.77 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 92], 5.00th=[ 161], 10.00th=[ 292], 20.00th=[ 693], 00:18:23.955 | 30.00th=[ 1003], 40.00th=[ 1053], 50.00th=[ 1183], 60.00th=[ 1485], 00:18:23.955 | 70.00th=[ 3071], 80.00th=[ 3239], 90.00th=[ 3608], 95.00th=[ 3641], 00:18:23.955 | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], 00:18:23.955 | 99.99th=[ 5000] 00:18:23.955 bw ( KiB/s): min= 6144, max=122880, per=2.53%, avg=81578.67, stdev=44407.45, samples=6 00:18:23.955 iops : min= 6, max= 120, avg=79.67, stdev=43.37, samples=6 00:18:23.955 lat (msec) : 50=0.23%, 100=1.81%, 250=6.80%, 500=6.80%, 750=5.90% 00:18:23.955 lat (msec) : 1000=7.26%, 2000=39.91%, >=2000=31.29% 00:18:23.955 cpu : usr=0.00%, sys=1.07%, ctx=881, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.3%, >=64=85.7% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.955 issued rwts: total=441,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job0: (groupid=0, jobs=1): err= 0: pid=993757: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=61, BW=61.9MiB/s (65.0MB/s)(762MiB/12301msec) 00:18:23.955 slat (usec): min=43, max=2161.8k, avg=13356.89, stdev=120960.14 00:18:23.955 clat (msec): min=388, max=5258, avg=1677.03, stdev=1668.46 00:18:23.955 lat (msec): min=397, max=5267, avg=1690.39, stdev=1673.51 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 443], 5.00th=[ 535], 10.00th=[ 575], 20.00th=[ 625], 00:18:23.955 | 30.00th=[ 667], 40.00th=[ 751], 50.00th=[ 802], 60.00th=[ 869], 00:18:23.955 | 70.00th=[ 995], 80.00th=[ 4178], 90.00th=[ 4732], 95.00th=[ 5067], 00:18:23.955 | 99.00th=[ 5201], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:18:23.955 | 99.99th=[ 5269] 00:18:23.955 bw ( KiB/s): min= 1928, max=274432, per=4.04%, avg=130036.00, stdev=85733.33, samples=10 00:18:23.955 iops : min= 1, max= 268, avg=126.90, stdev=83.87, samples=10 00:18:23.955 lat (msec) : 500=3.15%, 750=36.22%, 1000=30.97%, 2000=5.25%, >=2000=24.41% 00:18:23.955 cpu : usr=0.01%, sys=1.58%, ctx=1963, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.0%, 16=2.1%, 32=4.2%, >=64=91.7% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.955 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.955 issued rwts: total=762,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.955 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.955 job1: (groupid=0, jobs=1): err= 0: pid=993762: Fri Apr 26 18:06:30 2024 00:18:23.955 read: IOPS=16, BW=16.4MiB/s (17.2MB/s)(200MiB/12209msec) 00:18:23.955 slat (usec): min=431, max=2079.0k, avg=50427.85, stdev=286412.30 00:18:23.955 clat (msec): min=886, max=11484, avg=7362.66, stdev=4477.98 00:18:23.955 lat (msec): min=894, max=11485, avg=7413.09, stdev=4467.27 00:18:23.955 clat percentiles (msec): 00:18:23.955 | 1.00th=[ 885], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 1011], 00:18:23.955 | 30.00th=[ 3104], 40.00th=[ 8356], 50.00th=[10671], 60.00th=[10939], 00:18:23.955 | 70.00th=[11073], 80.00th=[11208], 90.00th=[11342], 95.00th=[11476], 00:18:23.955 | 99.00th=[11476], 99.50th=[11476], 99.90th=[11476], 99.95th=[11476], 00:18:23.955 | 99.99th=[11476] 00:18:23.955 bw ( KiB/s): min= 1526, max=100352, per=0.66%, avg=21282.43, stdev=36103.54, samples=7 00:18:23.955 iops : min= 1, max= 98, avg=20.57, stdev=35.39, samples=7 00:18:23.955 lat (msec) : 1000=18.50%, 2000=7.50%, >=2000=74.00% 00:18:23.955 cpu : usr=0.01%, sys=0.71%, ctx=368, majf=0, minf=32769 00:18:23.955 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=4.0%, 16=8.0%, 32=16.0%, >=64=68.5% 00:18:23.955 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.4% 00:18:23.956 issued rwts: total=200,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993763: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=6, BW=6239KiB/s (6389kB/s)(75.0MiB/12309msec) 00:18:23.956 slat (usec): min=725, max=2110.9k, avg=135835.48, stdev=492179.22 00:18:23.956 clat (msec): min=2120, max=12306, avg=11154.40, stdev=2391.32 00:18:23.956 lat (msec): min=4181, max=12308, avg=11290.24, stdev=2148.21 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 2123], 5.00th=[ 4245], 10.00th=[ 6409], 20.00th=[10671], 00:18:23.956 | 30.00th=[12147], 40.00th=[12147], 50.00th=[12281], 60.00th=[12281], 00:18:23.956 | 70.00th=[12281], 80.00th=[12281], 90.00th=[12281], 95.00th=[12281], 00:18:23.956 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.956 | 99.99th=[12281] 00:18:23.956 lat (msec) : >=2000=100.00% 00:18:23.956 cpu : usr=0.01%, sys=0.70%, ctx=100, majf=0, minf=19201 00:18:23.956 IO depths : 1=1.3%, 2=2.7%, 4=5.3%, 8=10.7%, 16=21.3%, 32=42.7%, >=64=16.0% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.956 issued rwts: total=75,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993764: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=26, BW=27.0MiB/s (28.3MB/s)(329MiB/12207msec) 00:18:23.956 slat (usec): min=44, max=2067.8k, avg=30680.23, stdev=225189.41 00:18:23.956 clat (msec): min=531, max=11127, avg=4555.24, stdev=4583.85 00:18:23.956 lat (msec): min=534, max=11129, avg=4585.92, stdev=4593.60 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 550], 20.00th=[ 592], 00:18:23.956 | 30.00th=[ 634], 40.00th=[ 659], 50.00th=[ 743], 60.00th=[ 4799], 00:18:23.956 | 70.00th=[ 8490], 80.00th=[10805], 90.00th=[10939], 95.00th=[11073], 00:18:23.956 | 99.00th=[11073], 99.50th=[11073], 99.90th=[11073], 99.95th=[11073], 00:18:23.956 | 99.99th=[11073] 00:18:23.956 bw ( KiB/s): min= 1526, max=221184, per=1.60%, avg=51646.75, stdev=77158.71, samples=8 00:18:23.956 iops : min= 1, max= 216, avg=50.37, stdev=75.40, samples=8 00:18:23.956 lat (msec) : 750=50.76%, 1000=0.61%, >=2000=48.63% 00:18:23.956 cpu : usr=0.00%, sys=0.94%, ctx=275, majf=0, minf=32769 00:18:23.956 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.9%, 32=9.7%, >=64=80.9% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:18:23.956 issued rwts: total=329,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993765: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=16, BW=16.3MiB/s (17.1MB/s)(199MiB/12203msec) 00:18:23.956 slat (usec): min=563, max=2078.4k, avg=50650.51, stdev=269310.78 00:18:23.956 clat (msec): min=1120, max=8523, avg=5295.26, stdev=2614.76 00:18:23.956 lat (msec): min=1137, max=8530, avg=5345.91, stdev=2590.84 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 1133], 5.00th=[ 1167], 10.00th=[ 1234], 20.00th=[ 1435], 00:18:23.956 | 30.00th=[ 3440], 40.00th=[ 6342], 50.00th=[ 6946], 60.00th=[ 7080], 00:18:23.956 | 70.00th=[ 7282], 80.00th=[ 7416], 90.00th=[ 7617], 95.00th=[ 7684], 00:18:23.956 | 99.00th=[ 8490], 99.50th=[ 8557], 99.90th=[ 8557], 99.95th=[ 8557], 00:18:23.956 | 99.99th=[ 8557] 00:18:23.956 bw ( KiB/s): min= 1526, max=104448, per=0.76%, avg=24488.17, stdev=40066.70, samples=6 00:18:23.956 iops : min= 1, max= 102, avg=23.67, stdev=39.30, samples=6 00:18:23.956 lat (msec) : 2000=25.13%, >=2000=74.87% 00:18:23.956 cpu : usr=0.00%, sys=0.78%, ctx=415, majf=0, minf=32769 00:18:23.956 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=4.0%, 16=8.0%, 32=16.1%, >=64=68.3% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.4% 00:18:23.956 issued rwts: total=199,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993766: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=38, BW=38.7MiB/s (40.6MB/s)(471MiB/12170msec) 00:18:23.956 slat (usec): min=43, max=4269.6k, avg=21336.79, stdev=222118.83 00:18:23.956 clat (msec): min=408, max=10754, avg=3132.94, stdev=4039.32 00:18:23.956 lat (msec): min=408, max=10754, avg=3154.27, stdev=4049.67 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 409], 5.00th=[ 418], 10.00th=[ 443], 20.00th=[ 489], 00:18:23.956 | 30.00th=[ 617], 40.00th=[ 709], 50.00th=[ 751], 60.00th=[ 810], 00:18:23.956 | 70.00th=[ 902], 80.00th=[ 9597], 90.00th=[ 9866], 95.00th=[10134], 00:18:23.956 | 99.00th=[10805], 99.50th=[10805], 99.90th=[10805], 99.95th=[10805], 00:18:23.956 | 99.99th=[10805] 00:18:23.956 bw ( KiB/s): min= 1565, max=251904, per=2.73%, avg=88003.62, stdev=88926.80, samples=8 00:18:23.956 iops : min= 1, max= 246, avg=85.88, stdev=86.92, samples=8 00:18:23.956 lat (msec) : 500=21.66%, 750=28.45%, 1000=19.96%, 2000=2.12%, >=2000=27.81% 00:18:23.956 cpu : usr=0.02%, sys=0.99%, ctx=517, majf=0, minf=32769 00:18:23.956 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.4%, 32=6.8%, >=64=86.6% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.956 issued rwts: total=471,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993767: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=28, BW=28.5MiB/s (29.9MB/s)(348MiB/12215msec) 00:18:23.956 slat (usec): min=75, max=2115.8k, avg=29013.28, stdev=185445.47 00:18:23.956 clat (msec): min=728, max=10666, avg=3171.42, stdev=2496.35 00:18:23.956 lat (msec): min=739, max=12031, avg=3200.43, stdev=2530.53 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 735], 5.00th=[ 751], 10.00th=[ 776], 20.00th=[ 793], 00:18:23.956 | 30.00th=[ 802], 40.00th=[ 1636], 50.00th=[ 1787], 60.00th=[ 4396], 00:18:23.956 | 70.00th=[ 5537], 80.00th=[ 5873], 90.00th=[ 7013], 95.00th=[ 7148], 00:18:23.956 | 99.00th=[ 8557], 99.50th=[10671], 99.90th=[10671], 99.95th=[10671], 00:18:23.956 | 99.99th=[10671] 00:18:23.956 bw ( KiB/s): min= 1526, max=163840, per=1.56%, avg=50231.22, stdev=55193.52, samples=9 00:18:23.956 iops : min= 1, max= 160, avg=48.89, stdev=54.06, samples=9 00:18:23.956 lat (msec) : 750=4.31%, 1000=29.02%, 2000=24.71%, >=2000=41.95% 00:18:23.956 cpu : usr=0.00%, sys=1.02%, ctx=411, majf=0, minf=32769 00:18:23.956 IO depths : 1=0.3%, 2=0.6%, 4=1.1%, 8=2.3%, 16=4.6%, 32=9.2%, >=64=81.9% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:18:23.956 issued rwts: total=348,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993768: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=1, BW=1515KiB/s (1552kB/s)(18.0MiB/12165msec) 00:18:23.956 slat (msec): min=4, max=2127, avg=557.51, stdev=900.99 00:18:23.956 clat (msec): min=2129, max=12117, avg=7993.13, stdev=3159.58 00:18:23.956 lat (msec): min=4203, max=12164, avg=8550.64, stdev=2941.95 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 4212], 20.00th=[ 4245], 00:18:23.956 | 30.00th=[ 6342], 40.00th=[ 6409], 50.00th=[ 8490], 60.00th=[ 8490], 00:18:23.956 | 70.00th=[10671], 80.00th=[12013], 90.00th=[12147], 95.00th=[12147], 00:18:23.956 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.956 | 99.99th=[12147] 00:18:23.956 lat (msec) : >=2000=100.00% 00:18:23.956 cpu : usr=0.00%, sys=0.11%, ctx=58, majf=0, minf=4609 00:18:23.956 IO depths : 1=5.6%, 2=11.1%, 4=22.2%, 8=44.4%, 16=16.7%, 32=0.0%, >=64=0.0% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:23.956 issued rwts: total=18,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993769: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=104, BW=104MiB/s (109MB/s)(1053MiB/10118msec) 00:18:23.956 slat (usec): min=53, max=2038.6k, avg=9493.21, stdev=64688.22 00:18:23.956 clat (msec): min=116, max=3462, avg=1184.59, stdev=862.36 00:18:23.956 lat (msec): min=120, max=3470, avg=1194.08, stdev=865.25 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 138], 5.00th=[ 477], 10.00th=[ 625], 20.00th=[ 726], 00:18:23.956 | 30.00th=[ 776], 40.00th=[ 844], 50.00th=[ 936], 60.00th=[ 995], 00:18:23.956 | 70.00th=[ 1053], 80.00th=[ 1167], 90.00th=[ 3306], 95.00th=[ 3406], 00:18:23.956 | 99.00th=[ 3440], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], 00:18:23.956 | 99.99th=[ 3473] 00:18:23.956 bw ( KiB/s): min=20480, max=221184, per=3.68%, avg=118496.00, stdev=50358.77, samples=16 00:18:23.956 iops : min= 20, max= 216, avg=115.62, stdev=49.16, samples=16 00:18:23.956 lat (msec) : 250=2.28%, 500=3.51%, 750=18.71%, 1000=36.37%, 2000=26.40% 00:18:23.956 lat (msec) : >=2000=12.73% 00:18:23.956 cpu : usr=0.06%, sys=2.09%, ctx=1333, majf=0, minf=32769 00:18:23.956 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.5%, 32=3.0%, >=64=94.0% 00:18:23.956 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.956 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.956 issued rwts: total=1053,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.956 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.956 job1: (groupid=0, jobs=1): err= 0: pid=993770: Fri Apr 26 18:06:30 2024 00:18:23.956 read: IOPS=2, BW=2190KiB/s (2242kB/s)(26.0MiB/12158msec) 00:18:23.956 slat (usec): min=688, max=2107.6k, avg=385809.58, stdev=784584.90 00:18:23.956 clat (msec): min=2126, max=12154, avg=8765.57, stdev=3237.89 00:18:23.956 lat (msec): min=4190, max=12157, avg=9151.38, stdev=3004.31 00:18:23.956 clat percentiles (msec): 00:18:23.956 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4212], 20.00th=[ 6342], 00:18:23.956 | 30.00th=[ 6342], 40.00th=[ 8490], 50.00th=[ 8490], 60.00th=[10671], 00:18:23.956 | 70.00th=[12013], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:18:23.956 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.956 | 99.99th=[12147] 00:18:23.956 lat (msec) : >=2000=100.00% 00:18:23.956 cpu : usr=0.00%, sys=0.16%, ctx=63, majf=0, minf=6657 00:18:23.957 IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:23.957 issued rwts: total=26,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job1: (groupid=0, jobs=1): err= 0: pid=993771: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=39, BW=39.7MiB/s (41.6MB/s)(484MiB/12195msec) 00:18:23.957 slat (usec): min=39, max=2074.6k, avg=20804.56, stdev=168479.97 00:18:23.957 clat (msec): min=532, max=10212, avg=3084.82, stdev=3822.99 00:18:23.957 lat (msec): min=534, max=10256, avg=3105.62, stdev=3834.30 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 535], 5.00th=[ 542], 10.00th=[ 558], 20.00th=[ 600], 00:18:23.957 | 30.00th=[ 634], 40.00th=[ 693], 50.00th=[ 760], 60.00th=[ 827], 00:18:23.957 | 70.00th=[ 1838], 80.00th=[ 8557], 90.00th=[ 9866], 95.00th=[10134], 00:18:23.957 | 99.00th=[10134], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:18:23.957 | 99.99th=[10268] 00:18:23.957 bw ( KiB/s): min= 1526, max=243712, per=2.27%, avg=73060.90, stdev=82368.24, samples=10 00:18:23.957 iops : min= 1, max= 238, avg=71.20, stdev=80.58, samples=10 00:18:23.957 lat (msec) : 750=47.31%, 1000=19.83%, 2000=3.72%, >=2000=29.13% 00:18:23.957 cpu : usr=0.05%, sys=1.21%, ctx=403, majf=0, minf=32769 00:18:23.957 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.7%, 16=3.3%, 32=6.6%, >=64=87.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.957 issued rwts: total=484,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job1: (groupid=0, jobs=1): err= 0: pid=993772: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=1, BW=1685KiB/s (1725kB/s)(20.0MiB/12157msec) 00:18:23.957 slat (usec): min=1078, max=2127.3k, avg=501714.71, stdev=867975.09 00:18:23.957 clat (msec): min=2121, max=12154, avg=8128.00, stdev=3311.25 00:18:23.957 lat (msec): min=4189, max=12155, avg=8629.71, stdev=3107.18 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 4178], 20.00th=[ 4245], 00:18:23.957 | 30.00th=[ 6342], 40.00th=[ 6342], 50.00th=[ 8490], 60.00th=[ 8490], 00:18:23.957 | 70.00th=[10671], 80.00th=[12013], 90.00th=[12147], 95.00th=[12147], 00:18:23.957 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.957 | 99.99th=[12147] 00:18:23.957 lat (msec) : >=2000=100.00% 00:18:23.957 cpu : usr=0.02%, sys=0.11%, ctx=59, majf=0, minf=5121 00:18:23.957 IO depths : 1=5.0%, 2=10.0%, 4=20.0%, 8=40.0%, 16=25.0%, 32=0.0%, >=64=0.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:23.957 issued rwts: total=20,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job1: (groupid=0, jobs=1): err= 0: pid=993773: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=22, BW=22.4MiB/s (23.5MB/s)(274MiB/12246msec) 00:18:23.957 slat (usec): min=65, max=2120.5k, avg=36961.55, stdev=234801.48 00:18:23.957 clat (msec): min=658, max=6521, avg=3464.79, stdev=2313.00 00:18:23.957 lat (msec): min=661, max=6526, avg=3501.75, stdev=2314.53 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 659], 5.00th=[ 667], 10.00th=[ 676], 20.00th=[ 718], 00:18:23.957 | 30.00th=[ 785], 40.00th=[ 2123], 50.00th=[ 5067], 60.00th=[ 5201], 00:18:23.957 | 70.00th=[ 5336], 80.00th=[ 5470], 90.00th=[ 5604], 95.00th=[ 6477], 00:18:23.957 | 99.00th=[ 6544], 99.50th=[ 6544], 99.90th=[ 6544], 99.95th=[ 6544], 00:18:23.957 | 99.99th=[ 6544] 00:18:23.957 bw ( KiB/s): min= 1526, max=190464, per=1.87%, avg=60106.80, stdev=83011.79, samples=5 00:18:23.957 iops : min= 1, max= 186, avg=58.60, stdev=81.15, samples=5 00:18:23.957 lat (msec) : 750=26.64%, 1000=12.41%, 2000=0.73%, >=2000=60.22% 00:18:23.957 cpu : usr=0.00%, sys=1.00%, ctx=263, majf=0, minf=32769 00:18:23.957 IO depths : 1=0.4%, 2=0.7%, 4=1.5%, 8=2.9%, 16=5.8%, 32=11.7%, >=64=77.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=99.3%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.7% 00:18:23.957 issued rwts: total=274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job1: (groupid=0, jobs=1): err= 0: pid=993774: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=1, BW=1516KiB/s (1552kB/s)(18.0MiB/12161msec) 00:18:23.957 slat (usec): min=1046, max=4258.4k, avg=557687.78, stdev=1163196.48 00:18:23.957 clat (msec): min=2121, max=12132, avg=7190.95, stdev=3269.34 00:18:23.957 lat (msec): min=4178, max=12159, avg=7748.63, stdev=3209.36 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 4178], 20.00th=[ 4212], 00:18:23.957 | 30.00th=[ 4245], 40.00th=[ 6342], 50.00th=[ 6342], 60.00th=[ 6342], 00:18:23.957 | 70.00th=[10671], 80.00th=[10671], 90.00th=[12013], 95.00th=[12147], 00:18:23.957 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.957 | 99.99th=[12147] 00:18:23.957 lat (msec) : >=2000=100.00% 00:18:23.957 cpu : usr=0.00%, sys=0.12%, ctx=50, majf=0, minf=4609 00:18:23.957 IO depths : 1=5.6%, 2=11.1%, 4=22.2%, 8=44.4%, 16=16.7%, 32=0.0%, >=64=0.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0% 00:18:23.957 issued rwts: total=18,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job2: (groupid=0, jobs=1): err= 0: pid=993780: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=21, BW=21.1MiB/s (22.1MB/s)(257MiB/12190msec) 00:18:23.957 slat (usec): min=69, max=2049.9k, avg=39117.81, stdev=236706.50 00:18:23.957 clat (msec): min=925, max=11025, avg=5703.21, stdev=3910.50 00:18:23.957 lat (msec): min=945, max=11034, avg=5742.33, stdev=3914.28 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 944], 5.00th=[ 953], 10.00th=[ 961], 20.00th=[ 986], 00:18:23.957 | 30.00th=[ 1028], 40.00th=[ 5067], 50.00th=[ 5201], 60.00th=[ 6208], 00:18:23.957 | 70.00th=[10537], 80.00th=[10537], 90.00th=[10805], 95.00th=[10939], 00:18:23.957 | 99.00th=[10939], 99.50th=[10939], 99.90th=[11073], 99.95th=[11073], 00:18:23.957 | 99.99th=[11073] 00:18:23.957 bw ( KiB/s): min= 1526, max=108544, per=1.18%, avg=37959.71, stdev=37323.15, samples=7 00:18:23.957 iops : min= 1, max= 106, avg=37.00, stdev=36.53, samples=7 00:18:23.957 lat (msec) : 1000=24.51%, 2000=7.00%, >=2000=68.48% 00:18:23.957 cpu : usr=0.01%, sys=0.84%, ctx=430, majf=0, minf=32769 00:18:23.957 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=12.5%, >=64=75.5% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:18:23.957 issued rwts: total=257,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job2: (groupid=0, jobs=1): err= 0: pid=993781: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=4, BW=4863KiB/s (4980kB/s)(58.0MiB/12212msec) 00:18:23.957 slat (usec): min=608, max=2104.6k, avg=173986.99, stdev=537864.08 00:18:23.957 clat (msec): min=2119, max=12208, avg=7641.20, stdev=3689.19 00:18:23.957 lat (msec): min=3930, max=12211, avg=7815.19, stdev=3662.08 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 2123], 5.00th=[ 3943], 10.00th=[ 4010], 20.00th=[ 4077], 00:18:23.957 | 30.00th=[ 4111], 40.00th=[ 4212], 50.00th=[ 6342], 60.00th=[ 8490], 00:18:23.957 | 70.00th=[12147], 80.00th=[12147], 90.00th=[12147], 95.00th=[12147], 00:18:23.957 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.957 | 99.99th=[12147] 00:18:23.957 lat (msec) : >=2000=100.00% 00:18:23.957 cpu : usr=0.03%, sys=0.29%, ctx=105, majf=0, minf=14849 00:18:23.957 IO depths : 1=1.7%, 2=3.4%, 4=6.9%, 8=13.8%, 16=27.6%, 32=46.6%, >=64=0.0% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.957 issued rwts: total=58,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job2: (groupid=0, jobs=1): err= 0: pid=993782: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=72, BW=72.4MiB/s (75.9MB/s)(729MiB/10073msec) 00:18:23.957 slat (usec): min=38, max=2119.3k, avg=13732.43, stdev=134466.71 00:18:23.957 clat (msec): min=58, max=7140, avg=1695.86, stdev=2280.58 00:18:23.957 lat (msec): min=80, max=7201, avg=1709.59, stdev=2289.80 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 101], 5.00th=[ 222], 10.00th=[ 351], 20.00th=[ 481], 00:18:23.957 | 30.00th=[ 502], 40.00th=[ 527], 50.00th=[ 542], 60.00th=[ 609], 00:18:23.957 | 70.00th=[ 961], 80.00th=[ 2702], 90.00th=[ 6879], 95.00th=[ 7013], 00:18:23.957 | 99.00th=[ 7148], 99.50th=[ 7148], 99.90th=[ 7148], 99.95th=[ 7148], 00:18:23.957 | 99.99th=[ 7148] 00:18:23.957 bw ( KiB/s): min= 4096, max=247808, per=3.77%, avg=121333.90, stdev=96628.04, samples=10 00:18:23.957 iops : min= 4, max= 242, avg=118.40, stdev=94.24, samples=10 00:18:23.957 lat (msec) : 100=0.96%, 250=5.49%, 500=21.81%, 750=35.53%, 1000=7.68% 00:18:23.957 lat (msec) : 2000=6.45%, >=2000=22.09% 00:18:23.957 cpu : usr=0.06%, sys=1.50%, ctx=649, majf=0, minf=32769 00:18:23.957 IO depths : 1=0.1%, 2=0.3%, 4=0.5%, 8=1.1%, 16=2.2%, 32=4.4%, >=64=91.4% 00:18:23.957 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.957 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.957 issued rwts: total=729,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.957 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.957 job2: (groupid=0, jobs=1): err= 0: pid=993783: Fri Apr 26 18:06:30 2024 00:18:23.957 read: IOPS=27, BW=27.3MiB/s (28.7MB/s)(332MiB/12148msec) 00:18:23.957 slat (usec): min=39, max=2099.6k, avg=30208.75, stdev=213380.77 00:18:23.957 clat (msec): min=481, max=11056, avg=4477.77, stdev=4393.25 00:18:23.957 lat (msec): min=484, max=11057, avg=4507.97, stdev=4403.66 00:18:23.957 clat percentiles (msec): 00:18:23.957 | 1.00th=[ 485], 5.00th=[ 502], 10.00th=[ 506], 20.00th=[ 510], 00:18:23.957 | 30.00th=[ 600], 40.00th=[ 659], 50.00th=[ 768], 60.00th=[ 5134], 00:18:23.957 | 70.00th=[ 6812], 80.00th=[10805], 90.00th=[10939], 95.00th=[10939], 00:18:23.957 | 99.00th=[11073], 99.50th=[11073], 99.90th=[11073], 99.95th=[11073], 00:18:23.957 | 99.99th=[11073] 00:18:23.957 bw ( KiB/s): min= 1605, max=223232, per=1.63%, avg=52424.62, stdev=77772.28, samples=8 00:18:23.957 iops : min= 1, max= 218, avg=51.12, stdev=76.00, samples=8 00:18:23.958 lat (msec) : 500=2.11%, 750=47.29%, 1000=0.60%, >=2000=50.00% 00:18:23.958 cpu : usr=0.02%, sys=0.87%, ctx=380, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.8%, 32=9.6%, >=64=81.0% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:18:23.958 issued rwts: total=332,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993784: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=42, BW=42.8MiB/s (44.9MB/s)(521MiB/12178msec) 00:18:23.958 slat (usec): min=48, max=2061.4k, avg=19316.22, stdev=127673.30 00:18:23.958 clat (msec): min=622, max=6979, avg=2712.75, stdev=2258.33 00:18:23.958 lat (msec): min=624, max=6980, avg=2732.06, stdev=2260.71 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 625], 5.00th=[ 735], 10.00th=[ 885], 20.00th=[ 1167], 00:18:23.958 | 30.00th=[ 1368], 40.00th=[ 1435], 50.00th=[ 1569], 60.00th=[ 1888], 00:18:23.958 | 70.00th=[ 2198], 80.00th=[ 6409], 90.00th=[ 6745], 95.00th=[ 6879], 00:18:23.958 | 99.00th=[ 6946], 99.50th=[ 6946], 99.90th=[ 7013], 99.95th=[ 7013], 00:18:23.958 | 99.99th=[ 7013] 00:18:23.958 bw ( KiB/s): min= 1546, max=180224, per=2.50%, avg=80639.30, stdev=54476.06, samples=10 00:18:23.958 iops : min= 1, max= 176, avg=78.60, stdev=53.43, samples=10 00:18:23.958 lat (msec) : 750=5.37%, 1000=7.87%, 2000=50.29%, >=2000=36.47% 00:18:23.958 cpu : usr=0.01%, sys=0.94%, ctx=1072, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.5%, 16=3.1%, 32=6.1%, >=64=87.9% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.958 issued rwts: total=521,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993785: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=11, BW=12.0MiB/s (12.6MB/s)(146MiB/12185msec) 00:18:23.958 slat (usec): min=515, max=2088.6k, avg=68994.27, stdev=325429.59 00:18:23.958 clat (msec): min=1799, max=11874, avg=9832.63, stdev=2679.17 00:18:23.958 lat (msec): min=1805, max=11896, avg=9901.63, stdev=2602.74 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 1804], 5.00th=[ 3608], 10.00th=[ 5671], 20.00th=[ 8490], 00:18:23.958 | 30.00th=[10537], 40.00th=[10805], 50.00th=[10939], 60.00th=[11073], 00:18:23.958 | 70.00th=[11342], 80.00th=[11476], 90.00th=[11610], 95.00th=[11745], 00:18:23.958 | 99.00th=[11879], 99.50th=[11879], 99.90th=[11879], 99.95th=[11879], 00:18:23.958 | 99.99th=[11879] 00:18:23.958 bw ( KiB/s): min= 1526, max=10240, per=0.20%, avg=6394.83, stdev=3880.79, samples=6 00:18:23.958 iops : min= 1, max= 10, avg= 6.00, stdev= 3.74, samples=6 00:18:23.958 lat (msec) : 2000=3.42%, >=2000=96.58% 00:18:23.958 cpu : usr=0.00%, sys=0.67%, ctx=396, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.7%, 2=1.4%, 4=2.7%, 8=5.5%, 16=11.0%, 32=21.9%, >=64=56.8% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=95.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=5.0% 00:18:23.958 issued rwts: total=146,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993786: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=38, BW=38.2MiB/s (40.1MB/s)(467MiB/12211msec) 00:18:23.958 slat (usec): min=49, max=2140.3k, avg=21621.61, stdev=140841.08 00:18:23.958 clat (msec): min=955, max=8423, avg=3097.41, stdev=2769.71 00:18:23.958 lat (msec): min=961, max=8430, avg=3119.03, stdev=2775.82 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 1011], 5.00th=[ 1045], 10.00th=[ 1083], 20.00th=[ 1183], 00:18:23.958 | 30.00th=[ 1318], 40.00th=[ 1418], 50.00th=[ 1586], 60.00th=[ 1670], 00:18:23.958 | 70.00th=[ 1905], 80.00th=[ 7282], 90.00th=[ 7886], 95.00th=[ 8154], 00:18:23.958 | 99.00th=[ 8423], 99.50th=[ 8423], 99.90th=[ 8423], 99.95th=[ 8423], 00:18:23.958 | 99.99th=[ 8423] 00:18:23.958 bw ( KiB/s): min= 1526, max=126976, per=1.80%, avg=57986.92, stdev=49776.01, samples=12 00:18:23.958 iops : min= 1, max= 124, avg=56.58, stdev=48.66, samples=12 00:18:23.958 lat (msec) : 1000=0.86%, 2000=70.02%, >=2000=29.12% 00:18:23.958 cpu : usr=0.02%, sys=0.91%, ctx=953, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.4%, 32=6.9%, >=64=86.5% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.958 issued rwts: total=467,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993787: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=34, BW=34.3MiB/s (35.9MB/s)(419MiB/12224msec) 00:18:23.958 slat (usec): min=46, max=2102.3k, avg=24125.66, stdev=186767.93 00:18:23.958 clat (msec): min=568, max=10644, avg=2654.47, stdev=2733.12 00:18:23.958 lat (msec): min=581, max=10653, avg=2678.60, stdev=2752.63 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 584], 5.00th=[ 617], 10.00th=[ 625], 20.00th=[ 634], 00:18:23.958 | 30.00th=[ 667], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 693], 00:18:23.958 | 70.00th=[ 4396], 80.00th=[ 6544], 90.00th=[ 6745], 95.00th=[ 6879], 00:18:23.958 | 99.00th=[ 6946], 99.50th=[ 8557], 99.90th=[10671], 99.95th=[10671], 00:18:23.958 | 99.99th=[10671] 00:18:23.958 bw ( KiB/s): min= 1526, max=212992, per=2.65%, avg=85356.29, stdev=90469.07, samples=7 00:18:23.958 iops : min= 1, max= 208, avg=83.29, stdev=88.42, samples=7 00:18:23.958 lat (msec) : 750=61.81%, 1000=0.72%, >=2000=37.47% 00:18:23.958 cpu : usr=0.00%, sys=0.85%, ctx=398, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.0% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.958 issued rwts: total=419,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993788: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=79, BW=80.0MiB/s (83.9MB/s)(806MiB/10077msec) 00:18:23.958 slat (usec): min=42, max=2085.0k, avg=12463.78, stdev=108605.67 00:18:23.958 clat (msec): min=28, max=4315, avg=1505.78, stdev=1083.83 00:18:23.958 lat (msec): min=507, max=4316, avg=1518.24, stdev=1085.61 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 510], 5.00th=[ 514], 10.00th=[ 518], 20.00th=[ 558], 00:18:23.958 | 30.00th=[ 609], 40.00th=[ 760], 50.00th=[ 995], 60.00th=[ 1267], 00:18:23.958 | 70.00th=[ 2735], 80.00th=[ 2970], 90.00th=[ 3071], 95.00th=[ 3138], 00:18:23.958 | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4329], 99.95th=[ 4329], 00:18:23.958 | 99.99th=[ 4329] 00:18:23.958 bw ( KiB/s): min=10240, max=245760, per=3.92%, avg=126221.91, stdev=80578.41, samples=11 00:18:23.958 iops : min= 10, max= 240, avg=123.18, stdev=78.77, samples=11 00:18:23.958 lat (msec) : 50=0.12%, 750=38.46%, 1000=11.54%, 2000=18.36%, >=2000=31.51% 00:18:23.958 cpu : usr=0.00%, sys=1.35%, ctx=933, majf=0, minf=32769 00:18:23.958 IO depths : 1=0.1%, 2=0.2%, 4=0.5%, 8=1.0%, 16=2.0%, 32=4.0%, >=64=92.2% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.958 issued rwts: total=806,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993789: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=11, BW=11.8MiB/s (12.4MB/s)(145MiB/12303msec) 00:18:23.958 slat (usec): min=412, max=2084.3k, avg=70133.19, stdev=347951.12 00:18:23.958 clat (msec): min=2131, max=12271, avg=9846.57, stdev=2484.32 00:18:23.958 lat (msec): min=3835, max=12273, avg=9916.70, stdev=2406.99 00:18:23.958 clat percentiles (msec): 00:18:23.958 | 1.00th=[ 3842], 5.00th=[ 4212], 10.00th=[ 5940], 20.00th=[ 8087], 00:18:23.958 | 30.00th=[10402], 40.00th=[10402], 50.00th=[10537], 60.00th=[10537], 00:18:23.958 | 70.00th=[10671], 80.00th=[12147], 90.00th=[12281], 95.00th=[12281], 00:18:23.958 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.958 | 99.99th=[12281] 00:18:23.958 bw ( KiB/s): min= 1892, max=22528, per=0.29%, avg=9177.00, stdev=9717.22, samples=4 00:18:23.958 iops : min= 1, max= 22, avg= 8.75, stdev= 9.71, samples=4 00:18:23.958 lat (msec) : >=2000=100.00% 00:18:23.958 cpu : usr=0.00%, sys=0.97%, ctx=143, majf=0, minf=32395 00:18:23.958 IO depths : 1=0.7%, 2=1.4%, 4=2.8%, 8=5.5%, 16=11.0%, 32=22.1%, >=64=56.6% 00:18:23.958 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.958 complete : 0=0.0%, 4=94.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=5.3% 00:18:23.958 issued rwts: total=145,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.958 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.958 job2: (groupid=0, jobs=1): err= 0: pid=993790: Fri Apr 26 18:06:30 2024 00:18:23.958 read: IOPS=11, BW=11.1MiB/s (11.6MB/s)(136MiB/12248msec) 00:18:23.959 slat (usec): min=635, max=2112.7k, avg=74462.91, stdev=337199.14 00:18:23.959 clat (msec): min=2119, max=12221, avg=5602.03, stdev=2974.67 00:18:23.959 lat (msec): min=3245, max=12223, avg=5676.49, stdev=3013.18 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 3239], 5.00th=[ 3272], 10.00th=[ 3373], 20.00th=[ 3540], 00:18:23.959 | 30.00th=[ 3708], 40.00th=[ 3809], 50.00th=[ 3977], 60.00th=[ 4111], 00:18:23.959 | 70.00th=[ 6342], 80.00th=[ 8926], 90.00th=[10537], 95.00th=[12147], 00:18:23.959 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.959 | 99.99th=[12281] 00:18:23.959 bw ( KiB/s): min= 1526, max=16351, per=0.28%, avg=8938.50, stdev=10482.86, samples=2 00:18:23.959 iops : min= 1, max= 15, avg= 8.00, stdev= 9.90, samples=2 00:18:23.959 lat (msec) : >=2000=100.00% 00:18:23.959 cpu : usr=0.01%, sys=0.83%, ctx=236, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.7%, 2=1.5%, 4=2.9%, 8=5.9%, 16=11.8%, 32=23.5%, >=64=53.7% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=90.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=10.0% 00:18:23.959 issued rwts: total=136,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job2: (groupid=0, jobs=1): err= 0: pid=993791: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=27, BW=27.3MiB/s (28.6MB/s)(332MiB/12177msec) 00:18:23.959 slat (usec): min=42, max=2088.5k, avg=30273.31, stdev=223816.24 00:18:23.959 clat (msec): min=405, max=11069, avg=4455.45, stdev=4676.43 00:18:23.959 lat (msec): min=409, max=11071, avg=4485.73, stdev=4686.17 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 409], 5.00th=[ 418], 10.00th=[ 426], 20.00th=[ 451], 00:18:23.959 | 30.00th=[ 485], 40.00th=[ 584], 50.00th=[ 634], 60.00th=[ 4732], 00:18:23.959 | 70.00th=[ 8926], 80.00th=[10805], 90.00th=[10939], 95.00th=[11073], 00:18:23.959 | 99.00th=[11073], 99.50th=[11073], 99.90th=[11073], 99.95th=[11073], 00:18:23.959 | 99.99th=[11073] 00:18:23.959 bw ( KiB/s): min= 1551, max=258048, per=1.86%, avg=59906.14, stdev=93137.88, samples=7 00:18:23.959 iops : min= 1, max= 252, avg=58.43, stdev=91.01, samples=7 00:18:23.959 lat (msec) : 500=32.23%, 750=18.98%, 1000=2.11%, >=2000=46.69% 00:18:23.959 cpu : usr=0.01%, sys=0.94%, ctx=345, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.8%, 32=9.6%, >=64=81.0% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=99.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.5% 00:18:23.959 issued rwts: total=332,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job2: (groupid=0, jobs=1): err= 0: pid=993792: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=13, BW=13.1MiB/s (13.7MB/s)(161MiB/12298msec) 00:18:23.959 slat (usec): min=511, max=4136.6k, avg=63206.37, stdev=387207.94 00:18:23.959 clat (msec): min=2120, max=12223, avg=7398.56, stdev=3487.13 00:18:23.959 lat (msec): min=3293, max=12225, avg=7461.76, stdev=3482.64 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 3306], 5.00th=[ 3373], 10.00th=[ 3540], 20.00th=[ 3742], 00:18:23.959 | 30.00th=[ 3943], 40.00th=[ 4178], 50.00th=[ 8490], 60.00th=[ 8658], 00:18:23.959 | 70.00th=[ 8926], 80.00th=[12013], 90.00th=[12147], 95.00th=[12147], 00:18:23.959 | 99.00th=[12147], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.959 | 99.99th=[12281] 00:18:23.959 bw ( KiB/s): min= 1903, max=67584, per=1.08%, avg=34743.50, stdev=46443.48, samples=2 00:18:23.959 iops : min= 1, max= 66, avg=33.50, stdev=45.96, samples=2 00:18:23.959 lat (msec) : >=2000=100.00% 00:18:23.959 cpu : usr=0.00%, sys=1.03%, ctx=269, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.6%, 2=1.2%, 4=2.5%, 8=5.0%, 16=9.9%, 32=19.9%, >=64=60.9% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=97.1%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.9% 00:18:23.959 issued rwts: total=161,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993796: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=44, BW=44.0MiB/s (46.2MB/s)(446MiB/10130msec) 00:18:23.959 slat (usec): min=41, max=2005.2k, avg=22452.08, stdev=144619.31 00:18:23.959 clat (msec): min=114, max=6686, avg=2233.30, stdev=1937.78 00:18:23.959 lat (msec): min=134, max=6692, avg=2255.75, stdev=1946.84 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 148], 5.00th=[ 275], 10.00th=[ 456], 20.00th=[ 709], 00:18:23.959 | 30.00th=[ 1036], 40.00th=[ 1351], 50.00th=[ 1687], 60.00th=[ 1955], 00:18:23.959 | 70.00th=[ 2106], 80.00th=[ 3406], 90.00th=[ 6342], 95.00th=[ 6544], 00:18:23.959 | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6678], 99.95th=[ 6678], 00:18:23.959 | 99.99th=[ 6678] 00:18:23.959 bw ( KiB/s): min=24576, max=153600, per=2.53%, avg=81408.00, stdev=44946.15, samples=8 00:18:23.959 iops : min= 24, max= 150, avg=79.50, stdev=43.89, samples=8 00:18:23.959 lat (msec) : 250=4.04%, 500=8.07%, 750=8.74%, 1000=8.07%, 2000=32.06% 00:18:23.959 lat (msec) : >=2000=39.01% 00:18:23.959 cpu : usr=0.01%, sys=1.48%, ctx=742, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.2%, >=64=85.9% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.959 issued rwts: total=446,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993797: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=15, BW=15.6MiB/s (16.3MB/s)(189MiB/12153msec) 00:18:23.959 slat (usec): min=485, max=2134.6k, avg=53093.73, stdev=282473.20 00:18:23.959 clat (msec): min=1232, max=11405, avg=7678.10, stdev=3833.34 00:18:23.959 lat (msec): min=1240, max=11409, avg=7731.19, stdev=3815.93 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 1234], 5.00th=[ 1250], 10.00th=[ 1301], 20.00th=[ 3272], 00:18:23.959 | 30.00th=[ 3406], 40.00th=[ 8154], 50.00th=[ 8490], 60.00th=[10805], 00:18:23.959 | 70.00th=[10939], 80.00th=[11073], 90.00th=[11208], 95.00th=[11342], 00:18:23.959 | 99.00th=[11342], 99.50th=[11342], 99.90th=[11342], 99.95th=[11342], 00:18:23.959 | 99.99th=[11342] 00:18:23.959 bw ( KiB/s): min= 1577, max=49152, per=0.56%, avg=18072.14, stdev=17746.38, samples=7 00:18:23.959 iops : min= 1, max= 48, avg=17.57, stdev=17.42, samples=7 00:18:23.959 lat (msec) : 2000=14.29%, >=2000=85.71% 00:18:23.959 cpu : usr=0.00%, sys=0.77%, ctx=381, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.5%, 2=1.1%, 4=2.1%, 8=4.2%, 16=8.5%, 32=16.9%, >=64=66.7% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=98.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.6% 00:18:23.959 issued rwts: total=189,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993798: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=16, BW=16.7MiB/s (17.5MB/s)(203MiB/12190msec) 00:18:23.959 slat (usec): min=711, max=2079.3k, avg=49628.51, stdev=256379.30 00:18:23.959 clat (msec): min=1486, max=9261, avg=3586.61, stdev=2014.90 00:18:23.959 lat (msec): min=1491, max=9269, avg=3636.24, stdev=2045.93 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 1502], 5.00th=[ 1552], 10.00th=[ 1603], 20.00th=[ 2299], 00:18:23.959 | 30.00th=[ 2601], 40.00th=[ 2802], 50.00th=[ 2937], 60.00th=[ 3239], 00:18:23.959 | 70.00th=[ 3473], 80.00th=[ 5470], 90.00th=[ 5873], 95.00th=[ 9194], 00:18:23.959 | 99.00th=[ 9194], 99.50th=[ 9194], 99.90th=[ 9329], 99.95th=[ 9329], 00:18:23.959 | 99.99th=[ 9329] 00:18:23.959 bw ( KiB/s): min= 1526, max=77824, per=1.58%, avg=51020.67, stdev=42912.92, samples=3 00:18:23.959 iops : min= 1, max= 76, avg=49.33, stdev=41.93, samples=3 00:18:23.959 lat (msec) : 2000=14.78%, >=2000=85.22% 00:18:23.959 cpu : usr=0.00%, sys=0.99%, ctx=502, majf=0, minf=32769 00:18:23.959 IO depths : 1=0.5%, 2=1.0%, 4=2.0%, 8=3.9%, 16=7.9%, 32=15.8%, >=64=69.0% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=98.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.3% 00:18:23.959 issued rwts: total=203,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993799: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=8, BW=9208KiB/s (9429kB/s)(110MiB/12233msec) 00:18:23.959 slat (usec): min=409, max=2061.4k, avg=91953.55, stdev=387347.94 00:18:23.959 clat (msec): min=2117, max=12227, avg=10541.19, stdev=2472.76 00:18:23.959 lat (msec): min=4134, max=12232, avg=10633.15, stdev=2341.20 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 4144], 5.00th=[ 4144], 10.00th=[ 6342], 20.00th=[10671], 00:18:23.959 | 30.00th=[10671], 40.00th=[11476], 50.00th=[11610], 60.00th=[11745], 00:18:23.959 | 70.00th=[11879], 80.00th=[12013], 90.00th=[12147], 95.00th=[12281], 00:18:23.959 | 99.00th=[12281], 99.50th=[12281], 99.90th=[12281], 99.95th=[12281], 00:18:23.959 | 99.99th=[12281] 00:18:23.959 lat (msec) : >=2000=100.00% 00:18:23.959 cpu : usr=0.01%, sys=0.63%, ctx=166, majf=0, minf=28161 00:18:23.959 IO depths : 1=0.9%, 2=1.8%, 4=3.6%, 8=7.3%, 16=14.5%, 32=29.1%, >=64=42.7% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.959 issued rwts: total=110,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993800: Fri Apr 26 18:06:30 2024 00:18:23.959 read: IOPS=3, BW=3787KiB/s (3878kB/s)(45.0MiB/12167msec) 00:18:23.959 slat (usec): min=485, max=2061.8k, avg=223265.46, stdev=604475.07 00:18:23.959 clat (msec): min=2119, max=12148, avg=7735.64, stdev=2999.14 00:18:23.959 lat (msec): min=4154, max=12166, avg=7958.91, stdev=2945.02 00:18:23.959 clat percentiles (msec): 00:18:23.959 | 1.00th=[ 2123], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4212], 00:18:23.959 | 30.00th=[ 4245], 40.00th=[ 6342], 50.00th=[ 8490], 60.00th=[ 8490], 00:18:23.959 | 70.00th=[10537], 80.00th=[10671], 90.00th=[12013], 95.00th=[12147], 00:18:23.959 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.959 | 99.99th=[12147] 00:18:23.959 lat (msec) : >=2000=100.00% 00:18:23.959 cpu : usr=0.00%, sys=0.26%, ctx=107, majf=0, minf=11521 00:18:23.959 IO depths : 1=2.2%, 2=4.4%, 4=8.9%, 8=17.8%, 16=35.6%, 32=31.1%, >=64=0.0% 00:18:23.959 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.959 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.959 issued rwts: total=45,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.959 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.959 job3: (groupid=0, jobs=1): err= 0: pid=993801: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=87, BW=87.5MiB/s (91.7MB/s)(1067MiB/12200msec) 00:18:23.960 slat (usec): min=50, max=2040.6k, avg=9429.79, stdev=88156.80 00:18:23.960 clat (msec): min=223, max=7102, avg=1389.78, stdev=1901.03 00:18:23.960 lat (msec): min=223, max=7104, avg=1399.21, stdev=1907.34 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 279], 5.00th=[ 313], 10.00th=[ 355], 20.00th=[ 435], 00:18:23.960 | 30.00th=[ 542], 40.00th=[ 642], 50.00th=[ 743], 60.00th=[ 827], 00:18:23.960 | 70.00th=[ 911], 80.00th=[ 1053], 90.00th=[ 6409], 95.00th=[ 6611], 00:18:23.960 | 99.00th=[ 7080], 99.50th=[ 7080], 99.90th=[ 7080], 99.95th=[ 7080], 00:18:23.960 | 99.99th=[ 7080] 00:18:23.960 bw ( KiB/s): min= 1526, max=319488, per=4.27%, avg=137449.07, stdev=106690.95, samples=14 00:18:23.960 iops : min= 1, max= 312, avg=134.14, stdev=104.23, samples=14 00:18:23.960 lat (msec) : 250=0.66%, 500=23.99%, 750=25.87%, 1000=26.34%, 2000=9.93% 00:18:23.960 lat (msec) : >=2000=13.21% 00:18:23.960 cpu : usr=0.05%, sys=1.56%, ctx=1236, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=3.0%, >=64=94.1% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.960 issued rwts: total=1067,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993802: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=19, BW=19.2MiB/s (20.1MB/s)(193MiB/10070msec) 00:18:23.960 slat (usec): min=932, max=2084.0k, avg=51844.31, stdev=268901.26 00:18:23.960 clat (msec): min=62, max=9377, avg=2633.01, stdev=3162.44 00:18:23.960 lat (msec): min=73, max=9383, avg=2684.85, stdev=3196.78 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 73], 5.00th=[ 176], 10.00th=[ 296], 20.00th=[ 489], 00:18:23.960 | 30.00th=[ 676], 40.00th=[ 978], 50.00th=[ 1234], 60.00th=[ 1485], 00:18:23.960 | 70.00th=[ 1720], 80.00th=[ 5940], 90.00th=[ 9329], 95.00th=[ 9329], 00:18:23.960 | 99.00th=[ 9329], 99.50th=[ 9329], 99.90th=[ 9329], 99.95th=[ 9329], 00:18:23.960 | 99.99th=[ 9329] 00:18:23.960 bw ( KiB/s): min=36864, max=36864, per=1.14%, avg=36864.00, stdev= 0.00, samples=1 00:18:23.960 iops : min= 36, max= 36, avg=36.00, stdev= 0.00, samples=1 00:18:23.960 lat (msec) : 100=1.04%, 250=8.29%, 500=12.44%, 750=10.88%, 1000=8.81% 00:18:23.960 lat (msec) : 2000=34.20%, >=2000=24.35% 00:18:23.960 cpu : usr=0.00%, sys=1.24%, ctx=480, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.5%, 2=1.0%, 4=2.1%, 8=4.1%, 16=8.3%, 32=16.6%, >=64=67.4% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=1.5% 00:18:23.960 issued rwts: total=193,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993803: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=86, BW=86.9MiB/s (91.1MB/s)(1068MiB/12293msec) 00:18:23.960 slat (usec): min=44, max=2008.9k, avg=9512.28, stdev=91191.46 00:18:23.960 clat (msec): min=281, max=6561, avg=1330.48, stdev=1759.81 00:18:23.960 lat (msec): min=285, max=6561, avg=1339.99, stdev=1765.56 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 296], 5.00th=[ 326], 10.00th=[ 372], 20.00th=[ 498], 00:18:23.960 | 30.00th=[ 592], 40.00th=[ 634], 50.00th=[ 651], 60.00th=[ 676], 00:18:23.960 | 70.00th=[ 718], 80.00th=[ 860], 90.00th=[ 6007], 95.00th=[ 6208], 00:18:23.960 | 99.00th=[ 6477], 99.50th=[ 6477], 99.90th=[ 6544], 99.95th=[ 6544], 00:18:23.960 | 99.99th=[ 6544] 00:18:23.960 bw ( KiB/s): min= 1910, max=382976, per=4.99%, avg=160585.83, stdev=106254.68, samples=12 00:18:23.960 iops : min= 1, max= 374, avg=156.75, stdev=103.88, samples=12 00:18:23.960 lat (msec) : 500=20.41%, 750=53.93%, 1000=7.02%, 2000=0.94%, >=2000=17.70% 00:18:23.960 cpu : usr=0.01%, sys=1.61%, ctx=980, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=3.0%, >=64=94.1% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.960 issued rwts: total=1068,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993804: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=148, BW=148MiB/s (155MB/s)(1492MiB/10080msec) 00:18:23.960 slat (usec): min=47, max=828722, avg=6699.87, stdev=23659.88 00:18:23.960 clat (msec): min=76, max=1721, avg=823.39, stdev=539.58 00:18:23.960 lat (msec): min=91, max=1740, avg=830.09, stdev=542.62 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 123], 5.00th=[ 125], 10.00th=[ 126], 20.00th=[ 201], 00:18:23.960 | 30.00th=[ 376], 40.00th=[ 542], 50.00th=[ 793], 60.00th=[ 1083], 00:18:23.960 | 70.00th=[ 1301], 80.00th=[ 1418], 90.00th=[ 1552], 95.00th=[ 1586], 00:18:23.960 | 99.00th=[ 1653], 99.50th=[ 1670], 99.90th=[ 1720], 99.95th=[ 1720], 00:18:23.960 | 99.99th=[ 1720] 00:18:23.960 bw ( KiB/s): min= 2048, max=802816, per=4.82%, avg=155031.78, stdev=174890.70, samples=18 00:18:23.960 iops : min= 2, max= 784, avg=151.33, stdev=170.82, samples=18 00:18:23.960 lat (msec) : 100=0.20%, 250=24.66%, 500=10.19%, 750=14.01%, 1000=8.51% 00:18:23.960 lat (msec) : 2000=42.43% 00:18:23.960 cpu : usr=0.04%, sys=2.18%, ctx=1800, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.1%, 32=2.1%, >=64=95.8% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.960 issued rwts: total=1492,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993805: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=45, BW=45.7MiB/s (47.9MB/s)(460MiB/10062msec) 00:18:23.960 slat (usec): min=41, max=1982.7k, avg=21745.25, stdev=139021.03 00:18:23.960 clat (msec): min=57, max=7146, avg=1452.38, stdev=1446.02 00:18:23.960 lat (msec): min=62, max=7164, avg=1474.13, stdev=1471.28 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 71], 5.00th=[ 136], 10.00th=[ 241], 20.00th=[ 422], 00:18:23.960 | 30.00th=[ 651], 40.00th=[ 978], 50.00th=[ 1334], 60.00th=[ 1401], 00:18:23.960 | 70.00th=[ 1502], 80.00th=[ 1569], 90.00th=[ 3641], 95.00th=[ 3809], 00:18:23.960 | 99.00th=[ 7080], 99.50th=[ 7080], 99.90th=[ 7148], 99.95th=[ 7148], 00:18:23.960 | 99.99th=[ 7148] 00:18:23.960 bw ( KiB/s): min= 6144, max=227335, per=2.99%, avg=96217.71, stdev=70559.32, samples=7 00:18:23.960 iops : min= 6, max= 222, avg=93.71, stdev=69.02, samples=7 00:18:23.960 lat (msec) : 100=2.17%, 250=8.26%, 500=13.70%, 750=11.30%, 1000=4.57% 00:18:23.960 lat (msec) : 2000=48.26%, >=2000=11.74% 00:18:23.960 cpu : usr=0.05%, sys=1.09%, ctx=760, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.2%, 2=0.4%, 4=0.9%, 8=1.7%, 16=3.5%, 32=7.0%, >=64=86.3% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.960 issued rwts: total=460,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993806: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=64, BW=64.9MiB/s (68.1MB/s)(653MiB/10058msec) 00:18:23.960 slat (usec): min=38, max=1999.3k, avg=15316.08, stdev=120042.26 00:18:23.960 clat (msec): min=54, max=6858, avg=1201.41, stdev=1506.34 00:18:23.960 lat (msec): min=63, max=6869, avg=1216.72, stdev=1521.14 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 73], 5.00th=[ 247], 10.00th=[ 271], 20.00th=[ 305], 00:18:23.960 | 30.00th=[ 443], 40.00th=[ 667], 50.00th=[ 927], 60.00th=[ 969], 00:18:23.960 | 70.00th=[ 1036], 80.00th=[ 1183], 90.00th=[ 3205], 95.00th=[ 5403], 00:18:23.960 | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6879], 99.95th=[ 6879], 00:18:23.960 | 99.99th=[ 6879] 00:18:23.960 bw ( KiB/s): min=96448, max=305152, per=4.96%, avg=159776.00, stdev=76968.81, samples=6 00:18:23.960 iops : min= 94, max= 298, avg=156.00, stdev=75.20, samples=6 00:18:23.960 lat (msec) : 100=2.30%, 250=2.91%, 500=28.48%, 750=9.49%, 1000=21.13% 00:18:23.960 lat (msec) : 2000=25.11%, >=2000=10.57% 00:18:23.960 cpu : usr=0.01%, sys=1.08%, ctx=1062, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.2%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.5%, 32=4.9%, >=64=90.4% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.960 issued rwts: total=653,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993807: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=27, BW=28.0MiB/s (29.3MB/s)(285MiB/10190msec) 00:18:23.960 slat (usec): min=57, max=2081.6k, avg=35631.75, stdev=220159.44 00:18:23.960 clat (msec): min=33, max=6383, avg=2828.29, stdev=1936.61 00:18:23.960 lat (msec): min=375, max=6391, avg=2863.93, stdev=1949.81 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 376], 5.00th=[ 380], 10.00th=[ 422], 20.00th=[ 510], 00:18:23.960 | 30.00th=[ 1720], 40.00th=[ 1989], 50.00th=[ 2735], 60.00th=[ 3540], 00:18:23.960 | 70.00th=[ 3608], 80.00th=[ 3708], 90.00th=[ 6342], 95.00th=[ 6342], 00:18:23.960 | 99.00th=[ 6409], 99.50th=[ 6409], 99.90th=[ 6409], 99.95th=[ 6409], 00:18:23.960 | 99.99th=[ 6409] 00:18:23.960 bw ( KiB/s): min=24526, max=153600, per=2.50%, avg=80346.75, stdev=56725.74, samples=4 00:18:23.960 iops : min= 23, max= 150, avg=78.00, stdev=55.87, samples=4 00:18:23.960 lat (msec) : 50=0.35%, 500=18.95%, 750=4.56%, 2000=16.14%, >=2000=60.00% 00:18:23.960 cpu : usr=0.05%, sys=1.02%, ctx=420, majf=0, minf=32769 00:18:23.960 IO depths : 1=0.4%, 2=0.7%, 4=1.4%, 8=2.8%, 16=5.6%, 32=11.2%, >=64=77.9% 00:18:23.960 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.960 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:18:23.960 issued rwts: total=285,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.960 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.960 job3: (groupid=0, jobs=1): err= 0: pid=993808: Fri Apr 26 18:06:30 2024 00:18:23.960 read: IOPS=68, BW=68.3MiB/s (71.6MB/s)(690MiB/10101msec) 00:18:23.960 slat (usec): min=42, max=1988.2k, avg=14503.15, stdev=92549.72 00:18:23.960 clat (msec): min=90, max=5113, avg=1230.92, stdev=847.01 00:18:23.960 lat (msec): min=109, max=5145, avg=1245.42, stdev=859.87 00:18:23.960 clat percentiles (msec): 00:18:23.960 | 1.00th=[ 190], 5.00th=[ 464], 10.00th=[ 550], 20.00th=[ 718], 00:18:23.960 | 30.00th=[ 902], 40.00th=[ 978], 50.00th=[ 1045], 60.00th=[ 1167], 00:18:23.960 | 70.00th=[ 1334], 80.00th=[ 1552], 90.00th=[ 1720], 95.00th=[ 1787], 00:18:23.960 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5134], 99.95th=[ 5134], 00:18:23.960 | 99.99th=[ 5134] 00:18:23.961 bw ( KiB/s): min= 4104, max=221184, per=3.25%, avg=104706.73, stdev=59659.85, samples=11 00:18:23.961 iops : min= 4, max= 216, avg=102.18, stdev=58.22, samples=11 00:18:23.961 lat (msec) : 100=0.14%, 250=1.88%, 500=4.35%, 750=14.64%, 1000=23.33% 00:18:23.961 lat (msec) : 2000=51.01%, >=2000=4.64% 00:18:23.961 cpu : usr=0.02%, sys=1.45%, ctx=1252, majf=0, minf=32769 00:18:23.961 IO depths : 1=0.1%, 2=0.3%, 4=0.6%, 8=1.2%, 16=2.3%, 32=4.6%, >=64=90.9% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.961 issued rwts: total=690,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993816: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=99, BW=99.5MiB/s (104MB/s)(1007MiB/10124msec) 00:18:23.961 slat (usec): min=37, max=1343.0k, avg=9933.42, stdev=51960.55 00:18:23.961 clat (msec): min=116, max=3801, avg=1108.39, stdev=539.54 00:18:23.961 lat (msec): min=126, max=3816, avg=1118.32, stdev=541.91 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 220], 5.00th=[ 472], 10.00th=[ 542], 20.00th=[ 617], 00:18:23.961 | 30.00th=[ 735], 40.00th=[ 860], 50.00th=[ 1062], 60.00th=[ 1150], 00:18:23.961 | 70.00th=[ 1351], 80.00th=[ 1485], 90.00th=[ 1989], 95.00th=[ 2198], 00:18:23.961 | 99.00th=[ 2467], 99.50th=[ 2500], 99.90th=[ 2567], 99.95th=[ 3809], 00:18:23.961 | 99.99th=[ 3809] 00:18:23.961 bw ( KiB/s): min=53248, max=219136, per=3.73%, avg=120140.07, stdev=56487.81, samples=15 00:18:23.961 iops : min= 52, max= 214, avg=117.27, stdev=55.22, samples=15 00:18:23.961 lat (msec) : 250=1.89%, 500=3.38%, 750=26.51%, 1000=13.51%, 2000=44.89% 00:18:23.961 lat (msec) : >=2000=9.83% 00:18:23.961 cpu : usr=0.01%, sys=1.67%, ctx=1478, majf=0, minf=32769 00:18:23.961 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.8%, 16=1.6%, 32=3.2%, >=64=93.7% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.961 issued rwts: total=1007,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993817: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=4, BW=4442KiB/s (4548kB/s)(44.0MiB/10144msec) 00:18:23.961 slat (usec): min=1791, max=2049.1k, avg=227904.05, stdev=599421.45 00:18:23.961 clat (msec): min=115, max=8652, avg=5653.07, stdev=2123.95 00:18:23.961 lat (msec): min=2149, max=10143, avg=5880.98, stdev=2052.80 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 116], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 4279], 00:18:23.961 | 30.00th=[ 6074], 40.00th=[ 6208], 50.00th=[ 6208], 60.00th=[ 6275], 00:18:23.961 | 70.00th=[ 6409], 80.00th=[ 6477], 90.00th=[ 8557], 95.00th=[ 8658], 00:18:23.961 | 99.00th=[ 8658], 99.50th=[ 8658], 99.90th=[ 8658], 99.95th=[ 8658], 00:18:23.961 | 99.99th=[ 8658] 00:18:23.961 lat (msec) : 250=2.27%, >=2000=97.73% 00:18:23.961 cpu : usr=0.00%, sys=0.28%, ctx=118, majf=0, minf=11265 00:18:23.961 IO depths : 1=2.3%, 2=4.5%, 4=9.1%, 8=18.2%, 16=36.4%, 32=29.5%, >=64=0.0% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.961 issued rwts: total=44,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993818: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=7, BW=7791KiB/s (7978kB/s)(77.0MiB/10120msec) 00:18:23.961 slat (usec): min=448, max=2070.2k, avg=130868.39, stdev=456714.06 00:18:23.961 clat (msec): min=42, max=10110, avg=4761.16, stdev=3349.41 00:18:23.961 lat (msec): min=1707, max=10119, avg=4892.03, stdev=3359.48 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 43], 5.00th=[ 1720], 10.00th=[ 1754], 20.00th=[ 1854], 00:18:23.961 | 30.00th=[ 1938], 40.00th=[ 2039], 50.00th=[ 4245], 60.00th=[ 4279], 00:18:23.961 | 70.00th=[ 6409], 80.00th=[ 8557], 90.00th=[10000], 95.00th=[10134], 00:18:23.961 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:18:23.961 | 99.99th=[10134] 00:18:23.961 lat (msec) : 50=1.30%, 2000=33.77%, >=2000=64.94% 00:18:23.961 cpu : usr=0.00%, sys=0.50%, ctx=149, majf=0, minf=19713 00:18:23.961 IO depths : 1=1.3%, 2=2.6%, 4=5.2%, 8=10.4%, 16=20.8%, 32=41.6%, >=64=18.2% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.961 issued rwts: total=77,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993819: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=5, BW=5898KiB/s (6039kB/s)(59.0MiB/10244msec) 00:18:23.961 slat (usec): min=891, max=2086.4k, avg=171886.08, stdev=540665.93 00:18:23.961 clat (msec): min=102, max=10240, avg=7951.66, stdev=3053.26 00:18:23.961 lat (msec): min=2135, max=10243, avg=8123.55, stdev=2884.56 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 103], 5.00th=[ 2165], 10.00th=[ 2198], 20.00th=[ 4329], 00:18:23.961 | 30.00th=[ 6477], 40.00th=[ 8658], 50.00th=[10134], 60.00th=[10134], 00:18:23.961 | 70.00th=[10268], 80.00th=[10268], 90.00th=[10268], 95.00th=[10268], 00:18:23.961 | 99.00th=[10268], 99.50th=[10268], 99.90th=[10268], 99.95th=[10268], 00:18:23.961 | 99.99th=[10268] 00:18:23.961 lat (msec) : 250=1.69%, >=2000=98.31% 00:18:23.961 cpu : usr=0.00%, sys=0.65%, ctx=124, majf=0, minf=15105 00:18:23.961 IO depths : 1=1.7%, 2=3.4%, 4=6.8%, 8=13.6%, 16=27.1%, 32=47.5%, >=64=0.0% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.961 issued rwts: total=59,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993820: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=16, BW=16.3MiB/s (17.1MB/s)(164MiB/10053msec) 00:18:23.961 slat (usec): min=70, max=2072.5k, avg=61034.85, stdev=303565.27 00:18:23.961 clat (msec): min=42, max=8758, avg=2077.03, stdev=1749.38 00:18:23.961 lat (msec): min=947, max=8769, avg=2138.07, stdev=1816.98 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 936], 5.00th=[ 978], 10.00th=[ 1099], 20.00th=[ 1200], 00:18:23.961 | 30.00th=[ 1301], 40.00th=[ 1401], 50.00th=[ 1519], 60.00th=[ 1620], 00:18:23.961 | 70.00th=[ 1720], 80.00th=[ 1921], 90.00th=[ 5201], 95.00th=[ 7282], 00:18:23.961 | 99.00th=[ 8658], 99.50th=[ 8792], 99.90th=[ 8792], 99.95th=[ 8792], 00:18:23.961 | 99.99th=[ 8792] 00:18:23.961 bw ( KiB/s): min=73728, max=73728, per=2.29%, avg=73728.00, stdev= 0.00, samples=1 00:18:23.961 iops : min= 72, max= 72, avg=72.00, stdev= 0.00, samples=1 00:18:23.961 lat (msec) : 50=0.61%, 1000=7.93%, 2000=75.61%, >=2000=15.85% 00:18:23.961 cpu : usr=0.00%, sys=0.81%, ctx=212, majf=0, minf=32769 00:18:23.961 IO depths : 1=0.6%, 2=1.2%, 4=2.4%, 8=4.9%, 16=9.8%, 32=19.5%, >=64=61.6% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=97.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=2.6% 00:18:23.961 issued rwts: total=164,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993821: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=4, BW=4228KiB/s (4329kB/s)(42.0MiB/10173msec) 00:18:23.961 slat (usec): min=435, max=2076.9k, avg=239428.24, stdev=628207.93 00:18:23.961 clat (msec): min=115, max=10158, avg=7300.93, stdev=2945.43 00:18:23.961 lat (msec): min=2138, max=10172, avg=7540.36, stdev=2749.33 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 116], 5.00th=[ 2165], 10.00th=[ 2232], 20.00th=[ 4329], 00:18:23.961 | 30.00th=[ 6342], 40.00th=[ 6477], 50.00th=[ 8557], 60.00th=[ 8658], 00:18:23.961 | 70.00th=[10000], 80.00th=[10134], 90.00th=[10134], 95.00th=[10134], 00:18:23.961 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:18:23.961 | 99.99th=[10134] 00:18:23.961 lat (msec) : 250=2.38%, >=2000=97.62% 00:18:23.961 cpu : usr=0.00%, sys=0.34%, ctx=104, majf=0, minf=10753 00:18:23.961 IO depths : 1=2.4%, 2=4.8%, 4=9.5%, 8=19.0%, 16=38.1%, 32=26.2%, >=64=0.0% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.961 issued rwts: total=42,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993822: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=54, BW=54.9MiB/s (57.6MB/s)(558MiB/10160msec) 00:18:23.961 slat (usec): min=46, max=2038.9k, avg=18171.43, stdev=133415.06 00:18:23.961 clat (msec): min=18, max=5404, avg=1536.62, stdev=1148.74 00:18:23.961 lat (msec): min=464, max=5406, avg=1554.79, stdev=1158.08 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 464], 5.00th=[ 510], 10.00th=[ 527], 20.00th=[ 575], 00:18:23.961 | 30.00th=[ 651], 40.00th=[ 919], 50.00th=[ 1183], 60.00th=[ 1385], 00:18:23.961 | 70.00th=[ 1938], 80.00th=[ 2467], 90.00th=[ 2702], 95.00th=[ 3943], 00:18:23.961 | 99.00th=[ 5336], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], 00:18:23.961 | 99.99th=[ 5403] 00:18:23.961 bw ( KiB/s): min=14336, max=246252, per=3.91%, avg=125847.29, stdev=83141.23, samples=7 00:18:23.961 iops : min= 14, max= 240, avg=122.71, stdev=81.12, samples=7 00:18:23.961 lat (msec) : 20=0.18%, 500=2.69%, 750=30.65%, 1000=9.50%, 2000=27.42% 00:18:23.961 lat (msec) : >=2000=29.57% 00:18:23.961 cpu : usr=0.05%, sys=1.16%, ctx=1201, majf=0, minf=32769 00:18:23.961 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.4%, 16=2.9%, 32=5.7%, >=64=88.7% 00:18:23.961 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.961 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.961 issued rwts: total=558,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.961 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.961 job4: (groupid=0, jobs=1): err= 0: pid=993823: Fri Apr 26 18:06:30 2024 00:18:23.961 read: IOPS=5, BW=5157KiB/s (5281kB/s)(51.0MiB/10127msec) 00:18:23.961 slat (usec): min=429, max=2089.1k, avg=196279.18, stdev=579702.89 00:18:23.961 clat (msec): min=116, max=10125, avg=7017.74, stdev=2817.28 00:18:23.961 lat (msec): min=2139, max=10126, avg=7214.02, stdev=2671.78 00:18:23.961 clat percentiles (msec): 00:18:23.961 | 1.00th=[ 116], 5.00th=[ 2165], 10.00th=[ 2232], 20.00th=[ 4329], 00:18:23.961 | 30.00th=[ 6409], 40.00th=[ 6477], 50.00th=[ 8658], 60.00th=[ 8658], 00:18:23.961 | 70.00th=[ 8658], 80.00th=[10000], 90.00th=[10134], 95.00th=[10134], 00:18:23.961 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:18:23.961 | 99.99th=[10134] 00:18:23.961 lat (msec) : 250=1.96%, >=2000=98.04% 00:18:23.962 cpu : usr=0.00%, sys=0.36%, ctx=74, majf=0, minf=13057 00:18:23.962 IO depths : 1=2.0%, 2=3.9%, 4=7.8%, 8=15.7%, 16=31.4%, 32=39.2%, >=64=0.0% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.962 issued rwts: total=51,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job4: (groupid=0, jobs=1): err= 0: pid=993824: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=24, BW=24.9MiB/s (26.2MB/s)(303MiB/12149msec) 00:18:23.962 slat (usec): min=138, max=2031.9k, avg=33047.88, stdev=180798.73 00:18:23.962 clat (msec): min=769, max=8527, avg=3330.80, stdev=2081.46 00:18:23.962 lat (msec): min=772, max=10559, avg=3363.84, stdev=2107.56 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 776], 5.00th=[ 894], 10.00th=[ 1020], 20.00th=[ 1150], 00:18:23.962 | 30.00th=[ 1284], 40.00th=[ 2970], 50.00th=[ 3339], 60.00th=[ 3540], 00:18:23.962 | 70.00th=[ 3977], 80.00th=[ 5940], 90.00th=[ 6342], 95.00th=[ 6812], 00:18:23.962 | 99.00th=[ 8490], 99.50th=[ 8490], 99.90th=[ 8557], 99.95th=[ 8557], 00:18:23.962 | 99.99th=[ 8557] 00:18:23.962 bw ( KiB/s): min= 1592, max=149504, per=1.40%, avg=44999.00, stdev=47788.45, samples=8 00:18:23.962 iops : min= 1, max= 146, avg=43.87, stdev=46.74, samples=8 00:18:23.962 lat (msec) : 1000=9.57%, 2000=27.06%, >=2000=63.37% 00:18:23.962 cpu : usr=0.00%, sys=0.70%, ctx=500, majf=0, minf=32769 00:18:23.962 IO depths : 1=0.3%, 2=0.7%, 4=1.3%, 8=2.6%, 16=5.3%, 32=10.6%, >=64=79.2% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.6% 00:18:23.962 issued rwts: total=303,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job4: (groupid=0, jobs=1): err= 0: pid=993825: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=41, BW=41.5MiB/s (43.5MB/s)(423MiB/10204msec) 00:18:23.962 slat (usec): min=443, max=2135.6k, avg=24065.72, stdev=186310.92 00:18:23.962 clat (msec): min=22, max=6735, avg=2000.79, stdev=1964.07 00:18:23.962 lat (msec): min=482, max=6739, avg=2024.86, stdev=1973.26 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 481], 5.00th=[ 514], 10.00th=[ 542], 20.00th=[ 567], 00:18:23.962 | 30.00th=[ 575], 40.00th=[ 726], 50.00th=[ 835], 60.00th=[ 2299], 00:18:23.962 | 70.00th=[ 2534], 80.00th=[ 2702], 90.00th=[ 6611], 95.00th=[ 6745], 00:18:23.962 | 99.00th=[ 6745], 99.50th=[ 6745], 99.90th=[ 6745], 99.95th=[ 6745], 00:18:23.962 | 99.99th=[ 6745] 00:18:23.962 bw ( KiB/s): min= 8192, max=227328, per=4.69%, avg=151040.00, stdev=97881.76, samples=4 00:18:23.962 iops : min= 8, max= 222, avg=147.50, stdev=95.59, samples=4 00:18:23.962 lat (msec) : 50=0.24%, 500=3.07%, 750=37.83%, 1000=14.42%, >=2000=44.44% 00:18:23.962 cpu : usr=0.03%, sys=1.23%, ctx=1029, majf=0, minf=32769 00:18:23.962 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.1% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.962 issued rwts: total=423,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job4: (groupid=0, jobs=1): err= 0: pid=993826: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=3, BW=3117KiB/s (3192kB/s)(37.0MiB/12155msec) 00:18:23.962 slat (usec): min=877, max=2089.7k, avg=270809.23, stdev=669407.15 00:18:23.962 clat (msec): min=2134, max=12151, avg=7482.44, stdev=2894.90 00:18:23.962 lat (msec): min=4161, max=12154, avg=7753.25, stdev=2849.00 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 2140], 5.00th=[ 4178], 10.00th=[ 4178], 20.00th=[ 4245], 00:18:23.962 | 30.00th=[ 6342], 40.00th=[ 6342], 50.00th=[ 6409], 60.00th=[ 8490], 00:18:23.962 | 70.00th=[ 8490], 80.00th=[10671], 90.00th=[12013], 95.00th=[12147], 00:18:23.962 | 99.00th=[12147], 99.50th=[12147], 99.90th=[12147], 99.95th=[12147], 00:18:23.962 | 99.99th=[12147] 00:18:23.962 lat (msec) : >=2000=100.00% 00:18:23.962 cpu : usr=0.00%, sys=0.24%, ctx=70, majf=0, minf=9473 00:18:23.962 IO depths : 1=2.7%, 2=5.4%, 4=10.8%, 8=21.6%, 16=43.2%, 32=16.2%, >=64=0.0% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=100.0%, >=64=0.0% 00:18:23.962 issued rwts: total=37,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job4: (groupid=0, jobs=1): err= 0: pid=993827: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=41, BW=41.8MiB/s (43.8MB/s)(420MiB/10049msec) 00:18:23.962 slat (usec): min=88, max=2101.7k, avg=23868.58, stdev=164290.45 00:18:23.962 clat (msec): min=22, max=5153, avg=1945.65, stdev=1222.20 00:18:23.962 lat (msec): min=627, max=5164, avg=1969.52, stdev=1232.46 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 625], 5.00th=[ 684], 10.00th=[ 760], 20.00th=[ 986], 00:18:23.962 | 30.00th=[ 1062], 40.00th=[ 1183], 50.00th=[ 1267], 60.00th=[ 1452], 00:18:23.962 | 70.00th=[ 3104], 80.00th=[ 3306], 90.00th=[ 3440], 95.00th=[ 3641], 00:18:23.962 | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5134], 99.95th=[ 5134], 00:18:23.962 | 99.99th=[ 5134] 00:18:23.962 bw ( KiB/s): min= 8192, max=212992, per=2.65%, avg=85430.86, stdev=75319.96, samples=7 00:18:23.962 iops : min= 8, max= 208, avg=83.43, stdev=73.55, samples=7 00:18:23.962 lat (msec) : 50=0.24%, 750=9.29%, 1000=11.90%, 2000=41.90%, >=2000=36.67% 00:18:23.962 cpu : usr=0.00%, sys=0.90%, ctx=1033, majf=0, minf=32769 00:18:23.962 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.0% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.962 issued rwts: total=420,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job4: (groupid=0, jobs=1): err= 0: pid=993828: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=10, BW=10.4MiB/s (10.9MB/s)(105MiB/10136msec) 00:18:23.962 slat (usec): min=1246, max=2070.1k, avg=95543.77, stdev=366648.34 00:18:23.962 clat (msec): min=103, max=10133, avg=5889.57, stdev=1606.02 00:18:23.962 lat (msec): min=2128, max=10135, avg=5985.11, stdev=1556.11 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 2123], 5.00th=[ 2198], 10.00th=[ 5201], 20.00th=[ 5336], 00:18:23.962 | 30.00th=[ 5470], 40.00th=[ 5604], 50.00th=[ 5805], 60.00th=[ 6007], 00:18:23.962 | 70.00th=[ 6208], 80.00th=[ 6409], 90.00th=[ 8490], 95.00th=[ 8658], 00:18:23.962 | 99.00th=[10134], 99.50th=[10134], 99.90th=[10134], 99.95th=[10134], 00:18:23.962 | 99.99th=[10134] 00:18:23.962 lat (msec) : 250=0.95%, >=2000=99.05% 00:18:23.962 cpu : usr=0.00%, sys=0.63%, ctx=309, majf=0, minf=26881 00:18:23.962 IO depths : 1=1.0%, 2=1.9%, 4=3.8%, 8=7.6%, 16=15.2%, 32=30.5%, >=64=40.0% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0% 00:18:23.962 issued rwts: total=105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job5: (groupid=0, jobs=1): err= 0: pid=993833: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=90, BW=90.7MiB/s (95.1MB/s)(917MiB/10112msec) 00:18:23.962 slat (usec): min=39, max=1496.6k, avg=11007.22, stdev=66326.30 00:18:23.962 clat (msec): min=15, max=2624, avg=1213.13, stdev=656.93 00:18:23.962 lat (msec): min=526, max=2626, avg=1224.13, stdev=658.38 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 558], 5.00th=[ 592], 10.00th=[ 600], 20.00th=[ 625], 00:18:23.962 | 30.00th=[ 676], 40.00th=[ 760], 50.00th=[ 919], 60.00th=[ 1133], 00:18:23.962 | 70.00th=[ 1569], 80.00th=[ 2005], 90.00th=[ 2333], 95.00th=[ 2400], 00:18:23.962 | 99.00th=[ 2601], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], 00:18:23.962 | 99.99th=[ 2635] 00:18:23.962 bw ( KiB/s): min=16384, max=215040, per=3.58%, avg=115393.43, stdev=70811.97, samples=14 00:18:23.962 iops : min= 16, max= 210, avg=112.64, stdev=69.11, samples=14 00:18:23.962 lat (msec) : 20=0.11%, 750=38.93%, 1000=14.94%, 2000=25.52%, >=2000=20.50% 00:18:23.962 cpu : usr=0.02%, sys=1.43%, ctx=1682, majf=0, minf=32769 00:18:23.962 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.1% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.962 issued rwts: total=917,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job5: (groupid=0, jobs=1): err= 0: pid=993834: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=41, BW=41.4MiB/s (43.4MB/s)(421MiB/10162msec) 00:18:23.962 slat (usec): min=40, max=2135.2k, avg=23876.11, stdev=156356.73 00:18:23.962 clat (msec): min=107, max=5273, avg=2522.16, stdev=1402.91 00:18:23.962 lat (msec): min=1154, max=5284, avg=2546.04, stdev=1398.01 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 1150], 5.00th=[ 1234], 10.00th=[ 1334], 20.00th=[ 1485], 00:18:23.962 | 30.00th=[ 1586], 40.00th=[ 1687], 50.00th=[ 1787], 60.00th=[ 1821], 00:18:23.962 | 70.00th=[ 3239], 80.00th=[ 4396], 90.00th=[ 4732], 95.00th=[ 4933], 00:18:23.962 | 99.00th=[ 5201], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], 00:18:23.962 | 99.99th=[ 5269] 00:18:23.962 bw ( KiB/s): min= 6144, max=120832, per=2.07%, avg=66650.11, stdev=37625.47, samples=9 00:18:23.962 iops : min= 6, max= 118, avg=65.00, stdev=36.64, samples=9 00:18:23.962 lat (msec) : 250=0.24%, 2000=65.32%, >=2000=34.44% 00:18:23.962 cpu : usr=0.01%, sys=1.09%, ctx=789, majf=0, minf=32769 00:18:23.962 IO depths : 1=0.2%, 2=0.5%, 4=1.0%, 8=1.9%, 16=3.8%, 32=7.6%, >=64=85.0% 00:18:23.962 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.962 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.962 issued rwts: total=421,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.962 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.962 job5: (groupid=0, jobs=1): err= 0: pid=993835: Fri Apr 26 18:06:30 2024 00:18:23.962 read: IOPS=181, BW=181MiB/s (190MB/s)(1832MiB/10104msec) 00:18:23.962 slat (usec): min=41, max=1915.2k, avg=5457.69, stdev=46140.58 00:18:23.962 clat (msec): min=97, max=3010, avg=674.92, stdev=663.43 00:18:23.962 lat (msec): min=134, max=3012, avg=680.38, stdev=666.79 00:18:23.962 clat percentiles (msec): 00:18:23.962 | 1.00th=[ 144], 5.00th=[ 178], 10.00th=[ 205], 20.00th=[ 262], 00:18:23.962 | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 376], 60.00th=[ 634], 00:18:23.962 | 70.00th=[ 793], 80.00th=[ 995], 90.00th=[ 1116], 95.00th=[ 2702], 00:18:23.962 | 99.00th=[ 2970], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], 00:18:23.962 | 99.99th=[ 3004] 00:18:23.962 bw ( KiB/s): min=10240, max=604160, per=6.78%, avg=218177.00, stdev=170921.67, samples=16 00:18:23.963 iops : min= 10, max= 590, avg=213.00, stdev=166.95, samples=16 00:18:23.963 lat (msec) : 100=0.05%, 250=17.90%, 500=35.26%, 750=14.08%, 1000=14.63% 00:18:23.963 lat (msec) : 2000=11.14%, >=2000=6.93% 00:18:23.963 cpu : usr=0.03%, sys=2.47%, ctx=2642, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.9%, 32=1.7%, >=64=96.6% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.963 issued rwts: total=1832,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993836: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=48, BW=48.7MiB/s (51.1MB/s)(489MiB/10043msec) 00:18:23.963 slat (usec): min=48, max=2134.7k, avg=20504.43, stdev=139573.23 00:18:23.963 clat (msec): min=14, max=5660, avg=2102.35, stdev=1844.59 00:18:23.963 lat (msec): min=66, max=5719, avg=2122.85, stdev=1850.54 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 72], 5.00th=[ 194], 10.00th=[ 414], 20.00th=[ 768], 00:18:23.963 | 30.00th=[ 936], 40.00th=[ 978], 50.00th=[ 1083], 60.00th=[ 1284], 00:18:23.963 | 70.00th=[ 3138], 80.00th=[ 3608], 90.00th=[ 5470], 95.00th=[ 5537], 00:18:23.963 | 99.00th=[ 5671], 99.50th=[ 5671], 99.90th=[ 5671], 99.95th=[ 5671], 00:18:23.963 | 99.99th=[ 5671] 00:18:23.963 bw ( KiB/s): min= 2048, max=147456, per=1.88%, avg=60620.80, stdev=47886.04, samples=10 00:18:23.963 iops : min= 2, max= 144, avg=59.20, stdev=46.76, samples=10 00:18:23.963 lat (msec) : 20=0.20%, 100=3.07%, 250=3.07%, 500=6.34%, 750=6.13% 00:18:23.963 lat (msec) : 1000=25.56%, 2000=19.63%, >=2000=35.99% 00:18:23.963 cpu : usr=0.03%, sys=0.96%, ctx=719, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.3%, 32=6.5%, >=64=87.1% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.963 issued rwts: total=489,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993837: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=110, BW=110MiB/s (116MB/s)(1128MiB/10228msec) 00:18:23.963 slat (usec): min=40, max=1997.4k, avg=8957.93, stdev=71988.70 00:18:23.963 clat (msec): min=118, max=2937, avg=960.79, stdev=702.67 00:18:23.963 lat (msec): min=260, max=2953, avg=969.75, stdev=705.81 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 279], 5.00th=[ 288], 10.00th=[ 292], 20.00th=[ 296], 00:18:23.963 | 30.00th=[ 493], 40.00th=[ 550], 50.00th=[ 709], 60.00th=[ 936], 00:18:23.963 | 70.00th=[ 1133], 80.00th=[ 1452], 90.00th=[ 2299], 95.00th=[ 2433], 00:18:23.963 | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2903], 99.95th=[ 2937], 00:18:23.963 | 99.99th=[ 2937] 00:18:23.963 bw ( KiB/s): min=12288, max=452608, per=5.30%, avg=170666.67, stdev=131670.87, samples=12 00:18:23.963 iops : min= 12, max= 442, avg=166.67, stdev=128.58, samples=12 00:18:23.963 lat (msec) : 250=0.09%, 500=30.05%, 750=23.40%, 1000=10.11%, 2000=22.52% 00:18:23.963 lat (msec) : >=2000=13.83% 00:18:23.963 cpu : usr=0.04%, sys=1.61%, ctx=1727, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.4%, 32=2.8%, >=64=94.4% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.963 issued rwts: total=1128,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993838: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=24, BW=24.3MiB/s (25.5MB/s)(249MiB/10241msec) 00:18:23.963 slat (usec): min=77, max=2057.9k, avg=40645.06, stdev=226353.72 00:18:23.963 clat (msec): min=118, max=7649, avg=4458.21, stdev=2447.33 00:18:23.963 lat (msec): min=1397, max=7651, avg=4498.86, stdev=2430.36 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 1401], 5.00th=[ 1452], 10.00th=[ 1485], 20.00th=[ 1687], 00:18:23.963 | 30.00th=[ 2232], 40.00th=[ 2769], 50.00th=[ 4329], 60.00th=[ 6208], 00:18:23.963 | 70.00th=[ 6812], 80.00th=[ 7148], 90.00th=[ 7483], 95.00th=[ 7550], 00:18:23.963 | 99.00th=[ 7617], 99.50th=[ 7617], 99.90th=[ 7617], 99.95th=[ 7617], 00:18:23.963 | 99.99th=[ 7617] 00:18:23.963 bw ( KiB/s): min=10240, max=79872, per=1.10%, avg=35401.14, stdev=28321.56, samples=7 00:18:23.963 iops : min= 10, max= 78, avg=34.57, stdev=27.66, samples=7 00:18:23.963 lat (msec) : 250=0.40%, 2000=25.70%, >=2000=73.90% 00:18:23.963 cpu : usr=0.00%, sys=1.13%, ctx=530, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.2%, 16=6.4%, 32=12.9%, >=64=74.7% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.2%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.8% 00:18:23.963 issued rwts: total=249,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993839: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=108, BW=108MiB/s (113MB/s)(1083MiB/10014msec) 00:18:23.963 slat (usec): min=46, max=2055.5k, avg=9231.49, stdev=86900.98 00:18:23.963 clat (msec): min=12, max=4887, avg=971.15, stdev=1396.50 00:18:23.963 lat (msec): min=14, max=4892, avg=980.38, stdev=1402.99 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 23], 5.00th=[ 68], 10.00th=[ 136], 20.00th=[ 251], 00:18:23.963 | 30.00th=[ 266], 40.00th=[ 342], 50.00th=[ 393], 60.00th=[ 397], 00:18:23.963 | 70.00th=[ 477], 80.00th=[ 1183], 90.00th=[ 4279], 95.00th=[ 4799], 00:18:23.963 | 99.00th=[ 4799], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], 00:18:23.963 | 99.99th=[ 4866] 00:18:23.963 bw ( KiB/s): min= 6144, max=386299, per=4.73%, avg=152376.33, stdev=140239.17, samples=9 00:18:23.963 iops : min= 6, max= 377, avg=148.78, stdev=136.90, samples=9 00:18:23.963 lat (msec) : 20=0.65%, 50=2.77%, 100=4.34%, 250=11.63%, 500=51.06% 00:18:23.963 lat (msec) : 750=0.28%, 1000=2.03%, 2000=13.48%, >=2000=13.76% 00:18:23.963 cpu : usr=0.01%, sys=1.34%, ctx=2578, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=3.0%, >=64=94.2% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.963 issued rwts: total=1083,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993840: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=43, BW=43.6MiB/s (45.7MB/s)(441MiB/10110msec) 00:18:23.963 slat (usec): min=79, max=2144.4k, avg=22682.35, stdev=164405.36 00:18:23.963 clat (msec): min=105, max=5680, avg=2244.85, stdev=1838.36 00:18:23.963 lat (msec): min=117, max=5681, avg=2267.53, stdev=1841.71 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 126], 5.00th=[ 405], 10.00th=[ 426], 20.00th=[ 447], 00:18:23.963 | 30.00th=[ 1351], 40.00th=[ 1452], 50.00th=[ 1519], 60.00th=[ 1620], 00:18:23.963 | 70.00th=[ 2123], 80.00th=[ 4799], 90.00th=[ 5067], 95.00th=[ 5336], 00:18:23.963 | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5671], 99.95th=[ 5671], 00:18:23.963 | 99.99th=[ 5671] 00:18:23.963 bw ( KiB/s): min= 2048, max=288191, per=3.27%, avg=105375.83, stdev=112409.40, samples=6 00:18:23.963 iops : min= 2, max= 281, avg=102.83, stdev=109.63, samples=6 00:18:23.963 lat (msec) : 250=1.13%, 500=26.30%, 750=0.23%, 2000=41.04%, >=2000=31.29% 00:18:23.963 cpu : usr=0.03%, sys=0.97%, ctx=1224, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.2%, 2=0.5%, 4=0.9%, 8=1.8%, 16=3.6%, 32=7.3%, >=64=85.7% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.3% 00:18:23.963 issued rwts: total=441,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993841: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=91, BW=91.5MiB/s (96.0MB/s)(927MiB/10127msec) 00:18:23.963 slat (usec): min=56, max=2036.8k, avg=10793.25, stdev=93348.65 00:18:23.963 clat (msec): min=118, max=4343, avg=1307.61, stdev=1249.78 00:18:23.963 lat (msec): min=258, max=4394, avg=1318.41, stdev=1256.23 00:18:23.963 clat percentiles (msec): 00:18:23.963 | 1.00th=[ 259], 5.00th=[ 264], 10.00th=[ 266], 20.00th=[ 271], 00:18:23.963 | 30.00th=[ 317], 40.00th=[ 701], 50.00th=[ 1020], 60.00th=[ 1116], 00:18:23.963 | 70.00th=[ 1334], 80.00th=[ 1888], 90.00th=[ 4077], 95.00th=[ 4178], 00:18:23.963 | 99.00th=[ 4245], 99.50th=[ 4279], 99.90th=[ 4329], 99.95th=[ 4329], 00:18:23.963 | 99.99th=[ 4329] 00:18:23.963 bw ( KiB/s): min= 6144, max=481280, per=4.62%, avg=148759.27, stdev=141987.92, samples=11 00:18:23.963 iops : min= 6, max= 470, avg=145.27, stdev=138.66, samples=11 00:18:23.963 lat (msec) : 250=0.11%, 500=35.06%, 750=6.26%, 1000=7.12%, 2000=34.09% 00:18:23.963 lat (msec) : >=2000=17.37% 00:18:23.963 cpu : usr=0.02%, sys=1.29%, ctx=2022, majf=0, minf=32769 00:18:23.963 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.5%, >=64=93.2% 00:18:23.963 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.963 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.963 issued rwts: total=927,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.963 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.963 job5: (groupid=0, jobs=1): err= 0: pid=993842: Fri Apr 26 18:06:30 2024 00:18:23.963 read: IOPS=179, BW=180MiB/s (189MB/s)(1802MiB/10017msec) 00:18:23.964 slat (usec): min=48, max=2053.8k, avg=5546.95, stdev=63775.21 00:18:23.964 clat (msec): min=15, max=4637, avg=676.69, stdev=1069.90 00:18:23.964 lat (msec): min=18, max=4640, avg=682.24, stdev=1074.01 00:18:23.964 clat percentiles (msec): 00:18:23.964 | 1.00th=[ 56], 5.00th=[ 134], 10.00th=[ 171], 20.00th=[ 247], 00:18:23.964 | 30.00th=[ 259], 40.00th=[ 279], 50.00th=[ 347], 60.00th=[ 393], 00:18:23.964 | 70.00th=[ 535], 80.00th=[ 684], 90.00th=[ 818], 95.00th=[ 4463], 00:18:23.964 | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4665], 99.95th=[ 4665], 00:18:23.964 | 99.99th=[ 4665] 00:18:23.964 bw ( KiB/s): min= 2048, max=614400, per=7.61%, avg=244981.21, stdev=188343.97, samples=14 00:18:23.964 iops : min= 2, max= 600, avg=239.21, stdev=183.92, samples=14 00:18:23.964 lat (msec) : 20=0.11%, 50=0.78%, 100=1.44%, 250=23.81%, 500=41.45% 00:18:23.964 lat (msec) : 750=18.92%, 1000=6.22%, >=2000=7.27% 00:18:23.964 cpu : usr=0.06%, sys=2.20%, ctx=3173, majf=0, minf=32769 00:18:23.964 IO depths : 1=0.1%, 2=0.1%, 4=0.2%, 8=0.4%, 16=0.9%, 32=1.8%, >=64=96.5% 00:18:23.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.964 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.964 issued rwts: total=1802,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.964 job5: (groupid=0, jobs=1): err= 0: pid=993843: Fri Apr 26 18:06:30 2024 00:18:23.964 read: IOPS=93, BW=93.7MiB/s (98.3MB/s)(939MiB/10017msec) 00:18:23.964 slat (usec): min=429, max=4203.4k, avg=10647.68, stdev=144132.17 00:18:23.964 clat (msec): min=16, max=5588, avg=1114.09, stdev=1697.65 00:18:23.964 lat (msec): min=18, max=5594, avg=1124.74, stdev=1705.63 00:18:23.964 clat percentiles (msec): 00:18:23.964 | 1.00th=[ 35], 5.00th=[ 112], 10.00th=[ 209], 20.00th=[ 262], 00:18:23.964 | 30.00th=[ 271], 40.00th=[ 300], 50.00th=[ 334], 60.00th=[ 368], 00:18:23.964 | 70.00th=[ 418], 80.00th=[ 1418], 90.00th=[ 5000], 95.00th=[ 5269], 00:18:23.964 | 99.00th=[ 5537], 99.50th=[ 5537], 99.90th=[ 5604], 99.95th=[ 5604], 00:18:23.964 | 99.99th=[ 5604] 00:18:23.964 bw ( KiB/s): min=10240, max=477184, per=7.38%, avg=237538.86, stdev=185886.14, samples=7 00:18:23.964 iops : min= 10, max= 466, avg=231.86, stdev=181.50, samples=7 00:18:23.964 lat (msec) : 20=0.21%, 50=1.60%, 100=2.56%, 250=7.67%, 500=64.75% 00:18:23.964 lat (msec) : 750=0.32%, 2000=6.07%, >=2000=16.83% 00:18:23.964 cpu : usr=0.03%, sys=1.57%, ctx=2255, majf=0, minf=32769 00:18:23.964 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.9%, 16=1.7%, 32=3.4%, >=64=93.3% 00:18:23.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.964 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.964 issued rwts: total=939,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.964 job5: (groupid=0, jobs=1): err= 0: pid=993844: Fri Apr 26 18:06:30 2024 00:18:23.964 read: IOPS=108, BW=109MiB/s (114MB/s)(1088MiB/10015msec) 00:18:23.964 slat (usec): min=84, max=2194.2k, avg=9188.81, stdev=90907.57 00:18:23.964 clat (msec): min=14, max=6208, avg=1090.60, stdev=1691.89 00:18:23.964 lat (msec): min=16, max=6245, avg=1099.79, stdev=1699.77 00:18:23.964 clat percentiles (msec): 00:18:23.964 | 1.00th=[ 26], 5.00th=[ 72], 10.00th=[ 150], 20.00th=[ 253], 00:18:23.964 | 30.00th=[ 259], 40.00th=[ 326], 50.00th=[ 338], 60.00th=[ 401], 00:18:23.964 | 70.00th=[ 456], 80.00th=[ 1401], 90.00th=[ 5000], 95.00th=[ 5671], 00:18:23.964 | 99.00th=[ 6208], 99.50th=[ 6208], 99.90th=[ 6208], 99.95th=[ 6208], 00:18:23.964 | 99.99th=[ 6208] 00:18:23.964 bw ( KiB/s): min= 2043, max=575488, per=5.09%, avg=164010.25, stdev=188461.83, samples=12 00:18:23.964 iops : min= 1, max= 562, avg=160.08, stdev=184.12, samples=12 00:18:23.964 lat (msec) : 20=0.46%, 50=2.67%, 100=4.23%, 250=11.40%, 500=53.49% 00:18:23.964 lat (msec) : 750=0.46%, 2000=15.07%, >=2000=12.22% 00:18:23.964 cpu : usr=0.03%, sys=1.46%, ctx=2577, majf=0, minf=32769 00:18:23.964 IO depths : 1=0.1%, 2=0.2%, 4=0.4%, 8=0.7%, 16=1.5%, 32=2.9%, >=64=94.2% 00:18:23.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.964 complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:18:23.964 issued rwts: total=1088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.964 job5: (groupid=0, jobs=1): err= 0: pid=993845: Fri Apr 26 18:06:30 2024 00:18:23.964 read: IOPS=53, BW=53.4MiB/s (56.0MB/s)(543MiB/10166msec) 00:18:23.964 slat (usec): min=625, max=4180.8k, avg=18609.94, stdev=191573.19 00:18:23.964 clat (msec): min=58, max=6077, avg=1990.94, stdev=2009.27 00:18:23.964 lat (msec): min=380, max=6083, avg=2009.55, stdev=2015.94 00:18:23.964 clat percentiles (msec): 00:18:23.964 | 1.00th=[ 384], 5.00th=[ 397], 10.00th=[ 401], 20.00th=[ 414], 00:18:23.964 | 30.00th=[ 451], 40.00th=[ 493], 50.00th=[ 986], 60.00th=[ 1167], 00:18:23.964 | 70.00th=[ 3071], 80.00th=[ 5000], 90.00th=[ 5403], 95.00th=[ 5671], 00:18:23.964 | 99.00th=[ 6074], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], 00:18:23.964 | 99.99th=[ 6074] 00:18:23.964 bw ( KiB/s): min= 6144, max=310674, per=4.40%, avg=141549.67, stdev=118148.82, samples=6 00:18:23.964 iops : min= 6, max= 303, avg=138.17, stdev=115.27, samples=6 00:18:23.964 lat (msec) : 100=0.18%, 500=40.70%, 750=1.29%, 1000=8.47%, 2000=18.42% 00:18:23.964 lat (msec) : >=2000=30.94% 00:18:23.964 cpu : usr=0.01%, sys=1.43%, ctx=1562, majf=0, minf=32769 00:18:23.964 IO depths : 1=0.2%, 2=0.4%, 4=0.7%, 8=1.5%, 16=2.9%, 32=5.9%, >=64=88.4% 00:18:23.964 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:23.964 complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.2% 00:18:23.964 issued rwts: total=543,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:23.964 latency : target=0, window=0, percentile=100.00%, depth=128 00:18:23.964 00:18:23.964 Run status group 0 (all jobs): 00:18:23.964 READ: bw=3144MiB/s (3297MB/s), 1515KiB/s-183MiB/s (1552kB/s-192MB/s), io=37.8GiB (40.6GB), run=10014-12309msec 00:18:23.964 00:18:23.964 Disk stats (read/write): 00:18:23.964 nvme0n1: ios=68865/0, merge=0/0, ticks=7374496/0, in_queue=7374496, util=98.53% 00:18:23.964 nvme1n1: ios=27949/0, merge=0/0, ticks=7403199/0, in_queue=7403199, util=98.74% 00:18:23.964 nvme2n1: ios=36008/0, merge=0/0, ticks=7889403/0, in_queue=7889403, util=98.95% 00:18:23.964 nvme3n1: ios=55152/0, merge=0/0, ticks=7593795/0, in_queue=7593795, util=98.96% 00:18:23.964 nvme4n1: ios=26306/0, merge=0/0, ticks=7265733/0, in_queue=7265733, util=99.13% 00:18:23.964 nvme5n1: ios=92844/0, merge=0/0, ticks=6036754/0, in_queue=6036754, util=98.92% 00:18:23.964 18:06:31 -- target/srq_overwhelm.sh@38 -- # sync 00:18:23.964 18:06:31 -- target/srq_overwhelm.sh@40 -- # seq 0 5 00:18:23.964 18:06:31 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:23.964 18:06:31 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode0 00:18:23.964 NQN:nqn.2016-06.io.spdk:cnode0 disconnected 1 controller(s) 00:18:23.964 18:06:32 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000000 00:18:23.964 18:06:32 -- common/autotest_common.sh@1215 -- # local i=0 00:18:23.964 18:06:32 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:23.964 18:06:32 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000000 00:18:23.964 18:06:32 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:23.964 18:06:32 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000000 00:18:23.964 18:06:32 -- common/autotest_common.sh@1227 -- # return 0 00:18:23.964 18:06:32 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:23.964 18:06:32 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:23.964 18:06:32 -- common/autotest_common.sh@10 -- # set +x 00:18:23.964 18:06:32 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:23.964 18:06:32 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:23.964 18:06:32 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:23.964 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:18:23.964 18:06:33 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000001 00:18:23.964 18:06:33 -- common/autotest_common.sh@1215 -- # local i=0 00:18:23.964 18:06:33 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:23.964 18:06:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000001 00:18:24.223 18:06:33 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000001 00:18:24.223 18:06:33 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:24.223 18:06:33 -- common/autotest_common.sh@1227 -- # return 0 00:18:24.223 18:06:33 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:24.223 18:06:33 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:24.223 18:06:33 -- common/autotest_common.sh@10 -- # set +x 00:18:24.223 18:06:33 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:24.223 18:06:33 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:24.223 18:06:33 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:18:25.157 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:18:25.157 18:06:34 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000002 00:18:25.157 18:06:34 -- common/autotest_common.sh@1215 -- # local i=0 00:18:25.157 18:06:34 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:25.157 18:06:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000002 00:18:25.157 18:06:34 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:25.157 18:06:34 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000002 00:18:25.157 18:06:34 -- common/autotest_common.sh@1227 -- # return 0 00:18:25.157 18:06:34 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:18:25.157 18:06:34 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:25.157 18:06:34 -- common/autotest_common.sh@10 -- # set +x 00:18:25.157 18:06:34 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:25.157 18:06:34 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:25.157 18:06:34 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:18:26.093 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:18:26.093 18:06:35 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000003 00:18:26.093 18:06:35 -- common/autotest_common.sh@1215 -- # local i=0 00:18:26.093 18:06:35 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:26.093 18:06:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000003 00:18:26.093 18:06:35 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:26.093 18:06:35 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000003 00:18:26.093 18:06:35 -- common/autotest_common.sh@1227 -- # return 0 00:18:26.093 18:06:35 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:18:26.093 18:06:35 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:26.093 18:06:35 -- common/autotest_common.sh@10 -- # set +x 00:18:26.093 18:06:35 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:26.093 18:06:35 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:26.093 18:06:35 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:18:27.029 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:18:27.029 18:06:36 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000004 00:18:27.029 18:06:36 -- common/autotest_common.sh@1215 -- # local i=0 00:18:27.029 18:06:36 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:27.029 18:06:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000004 00:18:27.029 18:06:36 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:27.029 18:06:36 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000004 00:18:27.029 18:06:36 -- common/autotest_common.sh@1227 -- # return 0 00:18:27.029 18:06:36 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:18:27.029 18:06:36 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:27.029 18:06:36 -- common/autotest_common.sh@10 -- # set +x 00:18:27.029 18:06:36 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:27.029 18:06:36 -- target/srq_overwhelm.sh@40 -- # for i in $(seq 0 5) 00:18:27.029 18:06:36 -- target/srq_overwhelm.sh@41 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:18:27.966 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:18:27.966 18:06:37 -- target/srq_overwhelm.sh@42 -- # waitforserial_disconnect SPDK00000000000005 00:18:27.966 18:06:37 -- common/autotest_common.sh@1215 -- # local i=0 00:18:27.966 18:06:37 -- common/autotest_common.sh@1216 -- # lsblk -o NAME,SERIAL 00:18:27.966 18:06:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK00000000000005 00:18:27.966 18:06:37 -- common/autotest_common.sh@1223 -- # grep -q -w SPDK00000000000005 00:18:27.966 18:06:37 -- common/autotest_common.sh@1223 -- # lsblk -l -o NAME,SERIAL 00:18:28.226 18:06:37 -- common/autotest_common.sh@1227 -- # return 0 00:18:28.226 18:06:37 -- target/srq_overwhelm.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:18:28.226 18:06:37 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:28.226 18:06:37 -- common/autotest_common.sh@10 -- # set +x 00:18:28.226 18:06:37 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:28.226 18:06:37 -- target/srq_overwhelm.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:18:28.226 18:06:37 -- target/srq_overwhelm.sh@48 -- # nvmftestfini 00:18:28.226 18:06:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:28.226 18:06:37 -- nvmf/common.sh@117 -- # sync 00:18:28.226 18:06:37 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:28.226 18:06:37 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:28.226 18:06:37 -- nvmf/common.sh@120 -- # set +e 00:18:28.226 18:06:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:28.226 18:06:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:28.226 rmmod nvme_rdma 00:18:28.226 rmmod nvme_fabrics 00:18:28.226 18:06:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:28.226 18:06:37 -- nvmf/common.sh@124 -- # set -e 00:18:28.226 18:06:37 -- nvmf/common.sh@125 -- # return 0 00:18:28.226 18:06:37 -- nvmf/common.sh@478 -- # '[' -n 992600 ']' 00:18:28.226 18:06:37 -- nvmf/common.sh@479 -- # killprocess 992600 00:18:28.226 18:06:37 -- common/autotest_common.sh@946 -- # '[' -z 992600 ']' 00:18:28.226 18:06:37 -- common/autotest_common.sh@950 -- # kill -0 992600 00:18:28.226 18:06:37 -- common/autotest_common.sh@951 -- # uname 00:18:28.226 18:06:37 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:28.226 18:06:37 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 992600 00:18:28.226 18:06:37 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:18:28.226 18:06:37 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:18:28.226 18:06:37 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 992600' 00:18:28.226 killing process with pid 992600 00:18:28.226 18:06:37 -- common/autotest_common.sh@965 -- # kill 992600 00:18:28.226 18:06:37 -- common/autotest_common.sh@970 -- # wait 992600 00:18:28.226 [2024-04-26 18:06:37.330683] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:28.794 18:06:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:28.794 18:06:37 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:28.794 00:18:28.794 real 0m32.976s 00:18:28.794 user 1m51.109s 00:18:28.794 sys 0m16.200s 00:18:28.794 18:06:37 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:28.794 18:06:37 -- common/autotest_common.sh@10 -- # set +x 00:18:28.794 ************************************ 00:18:28.794 END TEST nvmf_srq_overwhelm 00:18:28.794 ************************************ 00:18:28.794 18:06:37 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:18:28.794 18:06:37 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:18:28.794 18:06:37 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:28.794 18:06:37 -- common/autotest_common.sh@10 -- # set +x 00:18:28.794 ************************************ 00:18:28.794 START TEST nvmf_shutdown 00:18:28.794 ************************************ 00:18:28.794 18:06:37 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=rdma 00:18:29.055 * Looking for test storage... 00:18:29.055 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target 00:18:29.055 18:06:38 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:29.055 18:06:38 -- nvmf/common.sh@7 -- # uname -s 00:18:29.055 18:06:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:29.055 18:06:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:29.055 18:06:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:29.055 18:06:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:29.055 18:06:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:29.055 18:06:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:29.055 18:06:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:29.055 18:06:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:29.055 18:06:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:29.055 18:06:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:29.055 18:06:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:18:29.055 18:06:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:18:29.055 18:06:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:29.055 18:06:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:29.055 18:06:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:29.055 18:06:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:29.055 18:06:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:29.055 18:06:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:29.055 18:06:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:29.055 18:06:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:29.055 18:06:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.055 18:06:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.055 18:06:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.055 18:06:38 -- paths/export.sh@5 -- # export PATH 00:18:29.055 18:06:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:29.055 18:06:38 -- nvmf/common.sh@47 -- # : 0 00:18:29.055 18:06:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:29.055 18:06:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:29.055 18:06:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:29.055 18:06:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:29.055 18:06:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:29.055 18:06:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:29.055 18:06:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:29.055 18:06:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:29.055 18:06:38 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:29.055 18:06:38 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:29.055 18:06:38 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:18:29.055 18:06:38 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:18:29.055 18:06:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:29.055 18:06:38 -- common/autotest_common.sh@10 -- # set +x 00:18:29.055 ************************************ 00:18:29.055 START TEST nvmf_shutdown_tc1 00:18:29.055 ************************************ 00:18:29.055 18:06:38 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc1 00:18:29.055 18:06:38 -- target/shutdown.sh@74 -- # starttarget 00:18:29.055 18:06:38 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:29.055 18:06:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:29.055 18:06:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:29.055 18:06:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:29.055 18:06:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:29.055 18:06:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:29.055 18:06:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:29.055 18:06:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:29.055 18:06:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:29.055 18:06:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:29.055 18:06:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:29.055 18:06:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:29.055 18:06:38 -- common/autotest_common.sh@10 -- # set +x 00:18:35.625 18:06:43 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:35.625 18:06:43 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:35.625 18:06:43 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:35.625 18:06:43 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:35.625 18:06:43 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:35.625 18:06:43 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:35.625 18:06:43 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:35.625 18:06:43 -- nvmf/common.sh@295 -- # net_devs=() 00:18:35.625 18:06:43 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:35.625 18:06:43 -- nvmf/common.sh@296 -- # e810=() 00:18:35.625 18:06:43 -- nvmf/common.sh@296 -- # local -ga e810 00:18:35.625 18:06:43 -- nvmf/common.sh@297 -- # x722=() 00:18:35.625 18:06:43 -- nvmf/common.sh@297 -- # local -ga x722 00:18:35.625 18:06:43 -- nvmf/common.sh@298 -- # mlx=() 00:18:35.625 18:06:43 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:35.625 18:06:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:35.625 18:06:43 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:35.625 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:35.625 18:06:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:35.625 18:06:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:35.625 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:35.625 18:06:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:35.625 18:06:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.625 18:06:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.625 18:06:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:35.625 Found net devices under 0000:18:00.0: mlx_0_0 00:18:35.625 18:06:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:35.625 18:06:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:35.625 18:06:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:35.625 Found net devices under 0000:18:00.1: mlx_0_1 00:18:35.625 18:06:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:35.625 18:06:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:35.625 18:06:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:35.625 18:06:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:35.625 18:06:43 -- nvmf/common.sh@58 -- # uname 00:18:35.625 18:06:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:35.625 18:06:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:35.625 18:06:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:35.625 18:06:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:35.625 18:06:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:35.625 18:06:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:35.625 18:06:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:35.625 18:06:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:35.625 18:06:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:35.625 18:06:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:35.625 18:06:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:35.625 18:06:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:35.625 18:06:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:35.625 18:06:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:35.625 18:06:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:35.625 18:06:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:35.625 18:06:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:35.625 18:06:43 -- nvmf/common.sh@105 -- # continue 2 00:18:35.625 18:06:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:35.625 18:06:43 -- nvmf/common.sh@105 -- # continue 2 00:18:35.625 18:06:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:35.625 18:06:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:35.625 18:06:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:35.625 18:06:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:35.625 18:06:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.625 18:06:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.625 18:06:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:35.625 18:06:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:35.625 18:06:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:35.625 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:35.625 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:18:35.625 altname enp24s0f0np0 00:18:35.625 altname ens785f0np0 00:18:35.625 inet 192.168.100.8/24 scope global mlx_0_0 00:18:35.625 valid_lft forever preferred_lft forever 00:18:35.625 18:06:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:35.625 18:06:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:35.625 18:06:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.625 18:06:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:35.625 18:06:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:35.625 18:06:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:35.625 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:35.625 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:18:35.625 altname enp24s0f1np1 00:18:35.625 altname ens785f1np1 00:18:35.625 inet 192.168.100.9/24 scope global mlx_0_1 00:18:35.625 valid_lft forever preferred_lft forever 00:18:35.625 18:06:44 -- nvmf/common.sh@411 -- # return 0 00:18:35.625 18:06:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:35.625 18:06:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:35.625 18:06:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:35.625 18:06:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:35.625 18:06:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:35.625 18:06:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:35.625 18:06:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:35.625 18:06:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:35.625 18:06:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:35.625 18:06:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:35.625 18:06:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.625 18:06:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:35.625 18:06:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:35.625 18:06:44 -- nvmf/common.sh@105 -- # continue 2 00:18:35.625 18:06:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:35.625 18:06:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:35.625 18:06:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:35.625 18:06:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:35.625 18:06:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@105 -- # continue 2 00:18:35.625 18:06:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:35.625 18:06:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:35.625 18:06:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.625 18:06:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:35.625 18:06:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:35.625 18:06:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:35.625 18:06:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:35.625 192.168.100.9' 00:18:35.625 18:06:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:35.625 192.168.100.9' 00:18:35.625 18:06:44 -- nvmf/common.sh@446 -- # head -n 1 00:18:35.625 18:06:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:35.625 18:06:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:35.625 192.168.100.9' 00:18:35.625 18:06:44 -- nvmf/common.sh@447 -- # head -n 1 00:18:35.625 18:06:44 -- nvmf/common.sh@447 -- # tail -n +2 00:18:35.625 18:06:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:35.625 18:06:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:35.625 18:06:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:35.625 18:06:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:35.625 18:06:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:35.625 18:06:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:35.625 18:06:44 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:35.625 18:06:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:35.625 18:06:44 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:35.625 18:06:44 -- common/autotest_common.sh@10 -- # set +x 00:18:35.625 18:06:44 -- nvmf/common.sh@470 -- # nvmfpid=999159 00:18:35.625 18:06:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:35.625 18:06:44 -- nvmf/common.sh@471 -- # waitforlisten 999159 00:18:35.625 18:06:44 -- common/autotest_common.sh@827 -- # '[' -z 999159 ']' 00:18:35.625 18:06:44 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:35.625 18:06:44 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:35.625 18:06:44 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:35.625 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:35.625 18:06:44 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:35.625 18:06:44 -- common/autotest_common.sh@10 -- # set +x 00:18:35.625 [2024-04-26 18:06:44.176625] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:35.625 [2024-04-26 18:06:44.176691] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:35.625 EAL: No free 2048 kB hugepages reported on node 1 00:18:35.625 [2024-04-26 18:06:44.250239] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:35.625 [2024-04-26 18:06:44.330370] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:35.625 [2024-04-26 18:06:44.330417] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:35.625 [2024-04-26 18:06:44.330426] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:35.625 [2024-04-26 18:06:44.330450] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:35.625 [2024-04-26 18:06:44.330457] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:35.625 [2024-04-26 18:06:44.330563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:35.625 [2024-04-26 18:06:44.330649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:35.625 [2024-04-26 18:06:44.330750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:35.625 [2024-04-26 18:06:44.330751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:35.884 18:06:44 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:35.884 18:06:44 -- common/autotest_common.sh@860 -- # return 0 00:18:35.884 18:06:44 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:35.884 18:06:44 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:35.884 18:06:44 -- common/autotest_common.sh@10 -- # set +x 00:18:35.884 18:06:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:35.884 18:06:45 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:35.884 18:06:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:35.884 18:06:45 -- common/autotest_common.sh@10 -- # set +x 00:18:35.884 [2024-04-26 18:06:45.070624] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x113c7c0/0x1140cb0) succeed. 00:18:36.144 [2024-04-26 18:06:45.081326] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x113de00/0x1182340) succeed. 00:18:36.144 18:06:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:36.144 18:06:45 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:36.144 18:06:45 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:36.144 18:06:45 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:36.144 18:06:45 -- common/autotest_common.sh@10 -- # set +x 00:18:36.144 18:06:45 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:36.144 18:06:45 -- target/shutdown.sh@28 -- # cat 00:18:36.144 18:06:45 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:36.144 18:06:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:36.144 18:06:45 -- common/autotest_common.sh@10 -- # set +x 00:18:36.144 Malloc1 00:18:36.144 [2024-04-26 18:06:45.321070] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:36.403 Malloc2 00:18:36.403 Malloc3 00:18:36.403 Malloc4 00:18:36.403 Malloc5 00:18:36.403 Malloc6 00:18:36.403 Malloc7 00:18:36.663 Malloc8 00:18:36.663 Malloc9 00:18:36.663 Malloc10 00:18:36.663 18:06:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:36.663 18:06:45 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:36.663 18:06:45 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:36.663 18:06:45 -- common/autotest_common.sh@10 -- # set +x 00:18:36.663 18:06:45 -- target/shutdown.sh@78 -- # perfpid=999514 00:18:36.663 18:06:45 -- target/shutdown.sh@79 -- # waitforlisten 999514 /var/tmp/bdevperf.sock 00:18:36.663 18:06:45 -- common/autotest_common.sh@827 -- # '[' -z 999514 ']' 00:18:36.663 18:06:45 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:36.663 18:06:45 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:36.663 18:06:45 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:18:36.663 18:06:45 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:36.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:36.663 18:06:45 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:36.663 18:06:45 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:36.663 18:06:45 -- common/autotest_common.sh@10 -- # set +x 00:18:36.663 18:06:45 -- nvmf/common.sh@521 -- # config=() 00:18:36.663 18:06:45 -- nvmf/common.sh@521 -- # local subsystem config 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 [2024-04-26 18:06:45.834037] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:36.663 [2024-04-26 18:06:45.834099] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.663 { 00:18:36.663 "params": { 00:18:36.663 "name": "Nvme$subsystem", 00:18:36.663 "trtype": "$TEST_TRANSPORT", 00:18:36.663 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.663 "adrfam": "ipv4", 00:18:36.663 "trsvcid": "$NVMF_PORT", 00:18:36.663 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.663 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.663 "hdgst": ${hdgst:-false}, 00:18:36.663 "ddgst": ${ddgst:-false} 00:18:36.663 }, 00:18:36.663 "method": "bdev_nvme_attach_controller" 00:18:36.663 } 00:18:36.663 EOF 00:18:36.663 )") 00:18:36.663 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.663 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.664 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.664 { 00:18:36.664 "params": { 00:18:36.664 "name": "Nvme$subsystem", 00:18:36.664 "trtype": "$TEST_TRANSPORT", 00:18:36.664 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.664 "adrfam": "ipv4", 00:18:36.664 "trsvcid": "$NVMF_PORT", 00:18:36.664 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.664 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.664 "hdgst": ${hdgst:-false}, 00:18:36.664 "ddgst": ${ddgst:-false} 00:18:36.664 }, 00:18:36.664 "method": "bdev_nvme_attach_controller" 00:18:36.664 } 00:18:36.664 EOF 00:18:36.664 )") 00:18:36.664 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.664 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.664 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.664 { 00:18:36.664 "params": { 00:18:36.664 "name": "Nvme$subsystem", 00:18:36.664 "trtype": "$TEST_TRANSPORT", 00:18:36.664 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.664 "adrfam": "ipv4", 00:18:36.664 "trsvcid": "$NVMF_PORT", 00:18:36.664 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.664 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.664 "hdgst": ${hdgst:-false}, 00:18:36.664 "ddgst": ${ddgst:-false} 00:18:36.664 }, 00:18:36.664 "method": "bdev_nvme_attach_controller" 00:18:36.664 } 00:18:36.664 EOF 00:18:36.664 )") 00:18:36.664 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.923 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.923 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.923 { 00:18:36.923 "params": { 00:18:36.923 "name": "Nvme$subsystem", 00:18:36.923 "trtype": "$TEST_TRANSPORT", 00:18:36.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.923 "adrfam": "ipv4", 00:18:36.923 "trsvcid": "$NVMF_PORT", 00:18:36.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.923 "hdgst": ${hdgst:-false}, 00:18:36.923 "ddgst": ${ddgst:-false} 00:18:36.923 }, 00:18:36.923 "method": "bdev_nvme_attach_controller" 00:18:36.923 } 00:18:36.923 EOF 00:18:36.923 )") 00:18:36.923 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.923 18:06:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:36.923 18:06:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:36.923 { 00:18:36.923 "params": { 00:18:36.923 "name": "Nvme$subsystem", 00:18:36.923 "trtype": "$TEST_TRANSPORT", 00:18:36.923 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:36.923 "adrfam": "ipv4", 00:18:36.923 "trsvcid": "$NVMF_PORT", 00:18:36.923 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:36.923 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:36.923 "hdgst": ${hdgst:-false}, 00:18:36.923 "ddgst": ${ddgst:-false} 00:18:36.923 }, 00:18:36.923 "method": "bdev_nvme_attach_controller" 00:18:36.923 } 00:18:36.923 EOF 00:18:36.923 )") 00:18:36.923 18:06:45 -- nvmf/common.sh@543 -- # cat 00:18:36.923 18:06:45 -- nvmf/common.sh@545 -- # jq . 00:18:36.923 18:06:45 -- nvmf/common.sh@546 -- # IFS=, 00:18:36.923 18:06:45 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:36.923 "params": { 00:18:36.923 "name": "Nvme1", 00:18:36.923 "trtype": "rdma", 00:18:36.923 "traddr": "192.168.100.8", 00:18:36.923 "adrfam": "ipv4", 00:18:36.923 "trsvcid": "4420", 00:18:36.923 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:36.923 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:36.923 "hdgst": false, 00:18:36.923 "ddgst": false 00:18:36.923 }, 00:18:36.923 "method": "bdev_nvme_attach_controller" 00:18:36.923 },{ 00:18:36.923 "params": { 00:18:36.923 "name": "Nvme2", 00:18:36.923 "trtype": "rdma", 00:18:36.923 "traddr": "192.168.100.8", 00:18:36.923 "adrfam": "ipv4", 00:18:36.923 "trsvcid": "4420", 00:18:36.923 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:36.923 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:36.923 "hdgst": false, 00:18:36.923 "ddgst": false 00:18:36.923 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme3", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme4", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme5", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme6", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme7", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme8", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme9", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 },{ 00:18:36.924 "params": { 00:18:36.924 "name": "Nvme10", 00:18:36.924 "trtype": "rdma", 00:18:36.924 "traddr": "192.168.100.8", 00:18:36.924 "adrfam": "ipv4", 00:18:36.924 "trsvcid": "4420", 00:18:36.924 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:36.924 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:36.924 "hdgst": false, 00:18:36.924 "ddgst": false 00:18:36.924 }, 00:18:36.924 "method": "bdev_nvme_attach_controller" 00:18:36.924 }' 00:18:36.924 EAL: No free 2048 kB hugepages reported on node 1 00:18:36.924 [2024-04-26 18:06:45.926013] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:36.924 [2024-04-26 18:06:46.005784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:37.861 18:06:46 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:37.861 18:06:46 -- common/autotest_common.sh@860 -- # return 0 00:18:37.861 18:06:46 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:37.861 18:06:46 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:37.861 18:06:46 -- common/autotest_common.sh@10 -- # set +x 00:18:37.861 18:06:46 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:37.861 18:06:46 -- target/shutdown.sh@83 -- # kill -9 999514 00:18:37.861 18:06:46 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:18:37.861 18:06:46 -- target/shutdown.sh@87 -- # sleep 1 00:18:38.799 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 999514 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:18:38.799 18:06:47 -- target/shutdown.sh@88 -- # kill -0 999159 00:18:38.799 18:06:47 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:18:38.799 18:06:47 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:38.799 18:06:47 -- nvmf/common.sh@521 -- # config=() 00:18:38.799 18:06:47 -- nvmf/common.sh@521 -- # local subsystem config 00:18:38.799 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.799 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.799 { 00:18:38.799 "params": { 00:18:38.799 "name": "Nvme$subsystem", 00:18:38.799 "trtype": "$TEST_TRANSPORT", 00:18:38.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.799 "adrfam": "ipv4", 00:18:38.799 "trsvcid": "$NVMF_PORT", 00:18:38.799 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.799 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.799 "hdgst": ${hdgst:-false}, 00:18:38.799 "ddgst": ${ddgst:-false} 00:18:38.799 }, 00:18:38.799 "method": "bdev_nvme_attach_controller" 00:18:38.799 } 00:18:38.799 EOF 00:18:38.799 )") 00:18:38.799 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.799 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.799 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.799 { 00:18:38.799 "params": { 00:18:38.799 "name": "Nvme$subsystem", 00:18:38.799 "trtype": "$TEST_TRANSPORT", 00:18:38.799 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 [2024-04-26 18:06:47.920631] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:38.800 [2024-04-26 18:06:47.920693] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid999779 ] 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 18:06:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:38.800 { 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme$subsystem", 00:18:38.800 "trtype": "$TEST_TRANSPORT", 00:18:38.800 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "$NVMF_PORT", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.800 "hdgst": ${hdgst:-false}, 00:18:38.800 "ddgst": ${ddgst:-false} 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 } 00:18:38.800 EOF 00:18:38.800 )") 00:18:38.800 18:06:47 -- nvmf/common.sh@543 -- # cat 00:18:38.800 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.800 18:06:47 -- nvmf/common.sh@545 -- # jq . 00:18:38.800 18:06:47 -- nvmf/common.sh@546 -- # IFS=, 00:18:38.800 18:06:47 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme1", 00:18:38.800 "trtype": "rdma", 00:18:38.800 "traddr": "192.168.100.8", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "4420", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:38.800 "hdgst": false, 00:18:38.800 "ddgst": false 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 },{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme2", 00:18:38.800 "trtype": "rdma", 00:18:38.800 "traddr": "192.168.100.8", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "4420", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:38.800 "hdgst": false, 00:18:38.800 "ddgst": false 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 },{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme3", 00:18:38.800 "trtype": "rdma", 00:18:38.800 "traddr": "192.168.100.8", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "4420", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:38.800 "hdgst": false, 00:18:38.800 "ddgst": false 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 },{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme4", 00:18:38.800 "trtype": "rdma", 00:18:38.800 "traddr": "192.168.100.8", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "4420", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:38.800 "hdgst": false, 00:18:38.800 "ddgst": false 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 },{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme5", 00:18:38.800 "trtype": "rdma", 00:18:38.800 "traddr": "192.168.100.8", 00:18:38.800 "adrfam": "ipv4", 00:18:38.800 "trsvcid": "4420", 00:18:38.800 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:38.800 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:38.800 "hdgst": false, 00:18:38.800 "ddgst": false 00:18:38.800 }, 00:18:38.800 "method": "bdev_nvme_attach_controller" 00:18:38.800 },{ 00:18:38.800 "params": { 00:18:38.800 "name": "Nvme6", 00:18:38.800 "trtype": "rdma", 00:18:38.801 "traddr": "192.168.100.8", 00:18:38.801 "adrfam": "ipv4", 00:18:38.801 "trsvcid": "4420", 00:18:38.801 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:38.801 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:38.801 "hdgst": false, 00:18:38.801 "ddgst": false 00:18:38.801 }, 00:18:38.801 "method": "bdev_nvme_attach_controller" 00:18:38.801 },{ 00:18:38.801 "params": { 00:18:38.801 "name": "Nvme7", 00:18:38.801 "trtype": "rdma", 00:18:38.801 "traddr": "192.168.100.8", 00:18:38.801 "adrfam": "ipv4", 00:18:38.801 "trsvcid": "4420", 00:18:38.801 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:38.801 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:38.801 "hdgst": false, 00:18:38.801 "ddgst": false 00:18:38.801 }, 00:18:38.801 "method": "bdev_nvme_attach_controller" 00:18:38.801 },{ 00:18:38.801 "params": { 00:18:38.801 "name": "Nvme8", 00:18:38.801 "trtype": "rdma", 00:18:38.801 "traddr": "192.168.100.8", 00:18:38.801 "adrfam": "ipv4", 00:18:38.801 "trsvcid": "4420", 00:18:38.801 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:38.801 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:38.801 "hdgst": false, 00:18:38.801 "ddgst": false 00:18:38.801 }, 00:18:38.801 "method": "bdev_nvme_attach_controller" 00:18:38.801 },{ 00:18:38.801 "params": { 00:18:38.801 "name": "Nvme9", 00:18:38.801 "trtype": "rdma", 00:18:38.801 "traddr": "192.168.100.8", 00:18:38.801 "adrfam": "ipv4", 00:18:38.801 "trsvcid": "4420", 00:18:38.801 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:38.801 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:38.801 "hdgst": false, 00:18:38.801 "ddgst": false 00:18:38.801 }, 00:18:38.801 "method": "bdev_nvme_attach_controller" 00:18:38.801 },{ 00:18:38.801 "params": { 00:18:38.801 "name": "Nvme10", 00:18:38.801 "trtype": "rdma", 00:18:38.801 "traddr": "192.168.100.8", 00:18:38.801 "adrfam": "ipv4", 00:18:38.801 "trsvcid": "4420", 00:18:38.801 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:38.801 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:38.801 "hdgst": false, 00:18:38.801 "ddgst": false 00:18:38.801 }, 00:18:38.801 "method": "bdev_nvme_attach_controller" 00:18:38.801 }' 00:18:39.060 [2024-04-26 18:06:47.997057] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.060 [2024-04-26 18:06:48.077039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:39.998 Running I/O for 1 seconds... 00:18:41.378 00:18:41.378 Latency(us) 00:18:41.378 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:41.378 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme1n1 : 1.18 366.02 22.88 0.00 0.00 171971.05 9346.00 238892.97 00:18:41.378 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme2n1 : 1.18 379.10 23.69 0.00 0.00 164120.61 10029.86 165948.55 00:18:41.378 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme3n1 : 1.18 378.72 23.67 0.00 0.00 161699.65 10827.69 159565.91 00:18:41.378 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme4n1 : 1.18 387.64 24.23 0.00 0.00 155860.49 6240.17 148624.25 00:18:41.378 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme5n1 : 1.19 377.90 23.62 0.00 0.00 158099.11 11397.57 142241.61 00:18:41.378 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme6n1 : 1.19 377.54 23.60 0.00 0.00 155681.45 11568.53 134947.17 00:18:41.378 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme7n1 : 1.19 377.21 23.58 0.00 0.00 153416.82 11568.53 130388.15 00:18:41.378 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme8n1 : 1.19 376.83 23.55 0.00 0.00 151561.03 11739.49 123093.70 00:18:41.378 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme9n1 : 1.19 375.67 23.48 0.00 0.00 150032.79 2806.65 111696.14 00:18:41.378 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:41.378 Verification LBA range: start 0x0 length 0x400 00:18:41.378 Nvme10n1 : 1.18 325.71 20.36 0.00 0.00 170815.37 9175.04 180537.43 00:18:41.378 =================================================================================================================== 00:18:41.378 Total : 3722.33 232.65 0.00 0.00 159104.63 2806.65 238892.97 00:18:41.378 18:06:50 -- target/shutdown.sh@94 -- # stoptarget 00:18:41.378 18:06:50 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:41.378 18:06:50 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:41.378 18:06:50 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:41.378 18:06:50 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:41.378 18:06:50 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:41.378 18:06:50 -- nvmf/common.sh@117 -- # sync 00:18:41.378 18:06:50 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:41.378 18:06:50 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:41.378 18:06:50 -- nvmf/common.sh@120 -- # set +e 00:18:41.378 18:06:50 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:41.378 18:06:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:41.378 rmmod nvme_rdma 00:18:41.378 rmmod nvme_fabrics 00:18:41.378 18:06:50 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:41.378 18:06:50 -- nvmf/common.sh@124 -- # set -e 00:18:41.378 18:06:50 -- nvmf/common.sh@125 -- # return 0 00:18:41.378 18:06:50 -- nvmf/common.sh@478 -- # '[' -n 999159 ']' 00:18:41.378 18:06:50 -- nvmf/common.sh@479 -- # killprocess 999159 00:18:41.378 18:06:50 -- common/autotest_common.sh@946 -- # '[' -z 999159 ']' 00:18:41.378 18:06:50 -- common/autotest_common.sh@950 -- # kill -0 999159 00:18:41.378 18:06:50 -- common/autotest_common.sh@951 -- # uname 00:18:41.378 18:06:50 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:41.378 18:06:50 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 999159 00:18:41.637 18:06:50 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:18:41.637 18:06:50 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:18:41.637 18:06:50 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 999159' 00:18:41.637 killing process with pid 999159 00:18:41.637 18:06:50 -- common/autotest_common.sh@965 -- # kill 999159 00:18:41.637 18:06:50 -- common/autotest_common.sh@970 -- # wait 999159 00:18:41.637 [2024-04-26 18:06:50.672178] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:42.206 18:06:51 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:42.206 18:06:51 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:42.206 00:18:42.206 real 0m12.922s 00:18:42.206 user 0m31.634s 00:18:42.206 sys 0m5.656s 00:18:42.206 18:06:51 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:42.206 18:06:51 -- common/autotest_common.sh@10 -- # set +x 00:18:42.206 ************************************ 00:18:42.206 END TEST nvmf_shutdown_tc1 00:18:42.206 ************************************ 00:18:42.206 18:06:51 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:18:42.206 18:06:51 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:18:42.206 18:06:51 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:42.206 18:06:51 -- common/autotest_common.sh@10 -- # set +x 00:18:42.206 ************************************ 00:18:42.206 START TEST nvmf_shutdown_tc2 00:18:42.206 ************************************ 00:18:42.206 18:06:51 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc2 00:18:42.206 18:06:51 -- target/shutdown.sh@99 -- # starttarget 00:18:42.206 18:06:51 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:42.206 18:06:51 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:42.206 18:06:51 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:42.206 18:06:51 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:42.206 18:06:51 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:42.206 18:06:51 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:42.206 18:06:51 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.206 18:06:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.206 18:06:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.206 18:06:51 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:42.206 18:06:51 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:42.206 18:06:51 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:42.206 18:06:51 -- common/autotest_common.sh@10 -- # set +x 00:18:42.206 18:06:51 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:42.206 18:06:51 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:42.206 18:06:51 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:42.206 18:06:51 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:42.206 18:06:51 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:42.206 18:06:51 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:42.206 18:06:51 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:42.206 18:06:51 -- nvmf/common.sh@295 -- # net_devs=() 00:18:42.206 18:06:51 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:42.206 18:06:51 -- nvmf/common.sh@296 -- # e810=() 00:18:42.206 18:06:51 -- nvmf/common.sh@296 -- # local -ga e810 00:18:42.206 18:06:51 -- nvmf/common.sh@297 -- # x722=() 00:18:42.206 18:06:51 -- nvmf/common.sh@297 -- # local -ga x722 00:18:42.206 18:06:51 -- nvmf/common.sh@298 -- # mlx=() 00:18:42.206 18:06:51 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:42.206 18:06:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:42.206 18:06:51 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:42.206 18:06:51 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:42.206 18:06:51 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:42.206 18:06:51 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:42.206 18:06:51 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:42.207 18:06:51 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:42.207 18:06:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:42.207 18:06:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:42.207 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:42.207 18:06:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:42.207 18:06:51 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:42.207 18:06:51 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:42.207 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:42.207 18:06:51 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:42.207 18:06:51 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:42.207 18:06:51 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:42.207 18:06:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.207 18:06:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:42.207 18:06:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.207 18:06:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:42.207 Found net devices under 0000:18:00.0: mlx_0_0 00:18:42.207 18:06:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:42.207 18:06:51 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:42.207 18:06:51 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:42.207 18:06:51 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:42.207 18:06:51 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:42.207 Found net devices under 0000:18:00.1: mlx_0_1 00:18:42.207 18:06:51 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:42.207 18:06:51 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:42.207 18:06:51 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:42.207 18:06:51 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:42.207 18:06:51 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:42.207 18:06:51 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:42.207 18:06:51 -- nvmf/common.sh@58 -- # uname 00:18:42.207 18:06:51 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:42.207 18:06:51 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:42.207 18:06:51 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:42.207 18:06:51 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:42.207 18:06:51 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:42.467 18:06:51 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:42.467 18:06:51 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:42.467 18:06:51 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:42.467 18:06:51 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:42.467 18:06:51 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:42.467 18:06:51 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:42.467 18:06:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:42.467 18:06:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:42.467 18:06:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:42.467 18:06:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:42.467 18:06:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:42.467 18:06:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@105 -- # continue 2 00:18:42.467 18:06:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@105 -- # continue 2 00:18:42.467 18:06:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:42.467 18:06:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:42.467 18:06:51 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:42.467 18:06:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:42.467 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:42.467 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:18:42.467 altname enp24s0f0np0 00:18:42.467 altname ens785f0np0 00:18:42.467 inet 192.168.100.8/24 scope global mlx_0_0 00:18:42.467 valid_lft forever preferred_lft forever 00:18:42.467 18:06:51 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:42.467 18:06:51 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:42.467 18:06:51 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:42.467 18:06:51 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:42.467 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:42.467 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:18:42.467 altname enp24s0f1np1 00:18:42.467 altname ens785f1np1 00:18:42.467 inet 192.168.100.9/24 scope global mlx_0_1 00:18:42.467 valid_lft forever preferred_lft forever 00:18:42.467 18:06:51 -- nvmf/common.sh@411 -- # return 0 00:18:42.467 18:06:51 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:42.467 18:06:51 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:42.467 18:06:51 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:42.467 18:06:51 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:42.467 18:06:51 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:42.467 18:06:51 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:42.467 18:06:51 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:42.467 18:06:51 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:42.467 18:06:51 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:42.467 18:06:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@105 -- # continue 2 00:18:42.467 18:06:51 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:42.467 18:06:51 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:42.467 18:06:51 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@105 -- # continue 2 00:18:42.467 18:06:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:42.467 18:06:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:42.467 18:06:51 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:42.467 18:06:51 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:42.467 18:06:51 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:42.467 18:06:51 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:42.467 192.168.100.9' 00:18:42.467 18:06:51 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:42.467 192.168.100.9' 00:18:42.467 18:06:51 -- nvmf/common.sh@446 -- # head -n 1 00:18:42.467 18:06:51 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:42.467 18:06:51 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:42.467 192.168.100.9' 00:18:42.467 18:06:51 -- nvmf/common.sh@447 -- # tail -n +2 00:18:42.467 18:06:51 -- nvmf/common.sh@447 -- # head -n 1 00:18:42.467 18:06:51 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:42.467 18:06:51 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:42.467 18:06:51 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:42.467 18:06:51 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:42.467 18:06:51 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:42.467 18:06:51 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:42.467 18:06:51 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:42.467 18:06:51 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:42.467 18:06:51 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:42.467 18:06:51 -- common/autotest_common.sh@10 -- # set +x 00:18:42.467 18:06:51 -- nvmf/common.sh@470 -- # nvmfpid=1000427 00:18:42.467 18:06:51 -- nvmf/common.sh@471 -- # waitforlisten 1000427 00:18:42.467 18:06:51 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:42.467 18:06:51 -- common/autotest_common.sh@827 -- # '[' -z 1000427 ']' 00:18:42.467 18:06:51 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:42.467 18:06:51 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:42.467 18:06:51 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:42.467 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:42.467 18:06:51 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:42.467 18:06:51 -- common/autotest_common.sh@10 -- # set +x 00:18:42.727 [2024-04-26 18:06:51.666020] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:42.727 [2024-04-26 18:06:51.666100] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:42.727 EAL: No free 2048 kB hugepages reported on node 1 00:18:42.727 [2024-04-26 18:06:51.737868] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:42.727 [2024-04-26 18:06:51.824524] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:42.727 [2024-04-26 18:06:51.824567] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:42.727 [2024-04-26 18:06:51.824577] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:42.727 [2024-04-26 18:06:51.824586] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:42.727 [2024-04-26 18:06:51.824593] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:42.727 [2024-04-26 18:06:51.824694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:42.727 [2024-04-26 18:06:51.824789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:42.727 [2024-04-26 18:06:51.824890] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:42.727 [2024-04-26 18:06:51.824891] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:43.296 18:06:52 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:43.296 18:06:52 -- common/autotest_common.sh@860 -- # return 0 00:18:43.296 18:06:52 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:43.296 18:06:52 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:43.296 18:06:52 -- common/autotest_common.sh@10 -- # set +x 00:18:43.555 18:06:52 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:43.555 18:06:52 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:43.555 18:06:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:43.555 18:06:52 -- common/autotest_common.sh@10 -- # set +x 00:18:43.555 [2024-04-26 18:06:52.548960] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x23ec7c0/0x23f0cb0) succeed. 00:18:43.555 [2024-04-26 18:06:52.559471] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x23ede00/0x2432340) succeed. 00:18:43.555 18:06:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:43.555 18:06:52 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:43.555 18:06:52 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:43.555 18:06:52 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:43.555 18:06:52 -- common/autotest_common.sh@10 -- # set +x 00:18:43.555 18:06:52 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.555 18:06:52 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:43.555 18:06:52 -- target/shutdown.sh@28 -- # cat 00:18:43.814 18:06:52 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:43.814 18:06:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:43.814 18:06:52 -- common/autotest_common.sh@10 -- # set +x 00:18:43.814 Malloc1 00:18:43.814 [2024-04-26 18:06:52.797293] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:43.814 Malloc2 00:18:43.814 Malloc3 00:18:43.814 Malloc4 00:18:43.814 Malloc5 00:18:44.074 Malloc6 00:18:44.074 Malloc7 00:18:44.074 Malloc8 00:18:44.074 Malloc9 00:18:44.074 Malloc10 00:18:44.074 18:06:53 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:44.074 18:06:53 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:44.074 18:06:53 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:44.074 18:06:53 -- common/autotest_common.sh@10 -- # set +x 00:18:44.074 18:06:53 -- target/shutdown.sh@103 -- # perfpid=1000662 00:18:44.074 18:06:53 -- target/shutdown.sh@104 -- # waitforlisten 1000662 /var/tmp/bdevperf.sock 00:18:44.074 18:06:53 -- common/autotest_common.sh@827 -- # '[' -z 1000662 ']' 00:18:44.074 18:06:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:44.074 18:06:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:44.074 18:06:53 -- target/shutdown.sh@102 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:18:44.074 18:06:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:44.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:44.074 18:06:53 -- target/shutdown.sh@102 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:44.074 18:06:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:44.074 18:06:53 -- nvmf/common.sh@521 -- # config=() 00:18:44.074 18:06:53 -- common/autotest_common.sh@10 -- # set +x 00:18:44.074 18:06:53 -- nvmf/common.sh@521 -- # local subsystem config 00:18:44.074 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.074 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.074 { 00:18:44.074 "params": { 00:18:44.074 "name": "Nvme$subsystem", 00:18:44.074 "trtype": "$TEST_TRANSPORT", 00:18:44.074 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.074 "adrfam": "ipv4", 00:18:44.074 "trsvcid": "$NVMF_PORT", 00:18:44.074 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.074 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.074 "hdgst": ${hdgst:-false}, 00:18:44.074 "ddgst": ${ddgst:-false} 00:18:44.074 }, 00:18:44.074 "method": "bdev_nvme_attach_controller" 00:18:44.074 } 00:18:44.074 EOF 00:18:44.074 )") 00:18:44.074 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.333 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.333 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.333 { 00:18:44.333 "params": { 00:18:44.333 "name": "Nvme$subsystem", 00:18:44.333 "trtype": "$TEST_TRANSPORT", 00:18:44.333 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.333 "adrfam": "ipv4", 00:18:44.333 "trsvcid": "$NVMF_PORT", 00:18:44.333 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.333 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.333 "hdgst": ${hdgst:-false}, 00:18:44.333 "ddgst": ${ddgst:-false} 00:18:44.333 }, 00:18:44.333 "method": "bdev_nvme_attach_controller" 00:18:44.333 } 00:18:44.333 EOF 00:18:44.333 )") 00:18:44.333 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.333 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.333 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.333 { 00:18:44.333 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 [2024-04-26 18:06:53.306089] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:44.334 [2024-04-26 18:06:53.306146] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1000662 ] 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 18:06:53 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:44.334 { 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme$subsystem", 00:18:44.334 "trtype": "$TEST_TRANSPORT", 00:18:44.334 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "$NVMF_PORT", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:44.334 "hdgst": ${hdgst:-false}, 00:18:44.334 "ddgst": ${ddgst:-false} 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 } 00:18:44.334 EOF 00:18:44.334 )") 00:18:44.334 18:06:53 -- nvmf/common.sh@543 -- # cat 00:18:44.334 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.334 18:06:53 -- nvmf/common.sh@545 -- # jq . 00:18:44.334 18:06:53 -- nvmf/common.sh@546 -- # IFS=, 00:18:44.334 18:06:53 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme1", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme2", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme3", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme4", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme5", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme6", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:44.334 "hdgst": false, 00:18:44.334 "ddgst": false 00:18:44.334 }, 00:18:44.334 "method": "bdev_nvme_attach_controller" 00:18:44.334 },{ 00:18:44.334 "params": { 00:18:44.334 "name": "Nvme7", 00:18:44.334 "trtype": "rdma", 00:18:44.334 "traddr": "192.168.100.8", 00:18:44.334 "adrfam": "ipv4", 00:18:44.334 "trsvcid": "4420", 00:18:44.334 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:44.334 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:44.334 "hdgst": false, 00:18:44.335 "ddgst": false 00:18:44.335 }, 00:18:44.335 "method": "bdev_nvme_attach_controller" 00:18:44.335 },{ 00:18:44.335 "params": { 00:18:44.335 "name": "Nvme8", 00:18:44.335 "trtype": "rdma", 00:18:44.335 "traddr": "192.168.100.8", 00:18:44.335 "adrfam": "ipv4", 00:18:44.335 "trsvcid": "4420", 00:18:44.335 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:44.335 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:44.335 "hdgst": false, 00:18:44.335 "ddgst": false 00:18:44.335 }, 00:18:44.335 "method": "bdev_nvme_attach_controller" 00:18:44.335 },{ 00:18:44.335 "params": { 00:18:44.335 "name": "Nvme9", 00:18:44.335 "trtype": "rdma", 00:18:44.335 "traddr": "192.168.100.8", 00:18:44.335 "adrfam": "ipv4", 00:18:44.335 "trsvcid": "4420", 00:18:44.335 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:44.335 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:44.335 "hdgst": false, 00:18:44.335 "ddgst": false 00:18:44.335 }, 00:18:44.335 "method": "bdev_nvme_attach_controller" 00:18:44.335 },{ 00:18:44.335 "params": { 00:18:44.335 "name": "Nvme10", 00:18:44.335 "trtype": "rdma", 00:18:44.335 "traddr": "192.168.100.8", 00:18:44.335 "adrfam": "ipv4", 00:18:44.335 "trsvcid": "4420", 00:18:44.335 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:44.335 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:44.335 "hdgst": false, 00:18:44.335 "ddgst": false 00:18:44.335 }, 00:18:44.335 "method": "bdev_nvme_attach_controller" 00:18:44.335 }' 00:18:44.335 [2024-04-26 18:06:53.381004] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.335 [2024-04-26 18:06:53.460837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:45.275 Running I/O for 10 seconds... 00:18:45.275 18:06:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:45.275 18:06:54 -- common/autotest_common.sh@860 -- # return 0 00:18:45.275 18:06:54 -- target/shutdown.sh@105 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:45.275 18:06:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:45.275 18:06:54 -- common/autotest_common.sh@10 -- # set +x 00:18:45.579 18:06:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:45.579 18:06:54 -- target/shutdown.sh@107 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:18:45.579 18:06:54 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:18:45.579 18:06:54 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:18:45.579 18:06:54 -- target/shutdown.sh@57 -- # local ret=1 00:18:45.579 18:06:54 -- target/shutdown.sh@58 -- # local i 00:18:45.579 18:06:54 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:18:45.579 18:06:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:45.579 18:06:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:45.579 18:06:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:45.579 18:06:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:45.579 18:06:54 -- common/autotest_common.sh@10 -- # set +x 00:18:45.579 18:06:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:45.579 18:06:54 -- target/shutdown.sh@60 -- # read_io_count=3 00:18:45.579 18:06:54 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:18:45.579 18:06:54 -- target/shutdown.sh@67 -- # sleep 0.25 00:18:45.838 18:06:54 -- target/shutdown.sh@59 -- # (( i-- )) 00:18:45.838 18:06:54 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:45.839 18:06:54 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:45.839 18:06:54 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:45.839 18:06:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:45.839 18:06:54 -- common/autotest_common.sh@10 -- # set +x 00:18:45.839 18:06:55 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:45.839 18:06:55 -- target/shutdown.sh@60 -- # read_io_count=155 00:18:45.839 18:06:55 -- target/shutdown.sh@63 -- # '[' 155 -ge 100 ']' 00:18:45.839 18:06:55 -- target/shutdown.sh@64 -- # ret=0 00:18:45.839 18:06:55 -- target/shutdown.sh@65 -- # break 00:18:45.839 18:06:55 -- target/shutdown.sh@69 -- # return 0 00:18:45.839 18:06:55 -- target/shutdown.sh@110 -- # killprocess 1000662 00:18:45.839 18:06:55 -- common/autotest_common.sh@946 -- # '[' -z 1000662 ']' 00:18:45.839 18:06:55 -- common/autotest_common.sh@950 -- # kill -0 1000662 00:18:45.839 18:06:55 -- common/autotest_common.sh@951 -- # uname 00:18:45.839 18:06:55 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:46.098 18:06:55 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1000662 00:18:46.098 18:06:55 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:18:46.098 18:06:55 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:18:46.098 18:06:55 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1000662' 00:18:46.098 killing process with pid 1000662 00:18:46.098 18:06:55 -- common/autotest_common.sh@965 -- # kill 1000662 00:18:46.098 18:06:55 -- common/autotest_common.sh@970 -- # wait 1000662 00:18:46.098 Received shutdown signal, test time was about 0.823851 seconds 00:18:46.098 00:18:46.098 Latency(us) 00:18:46.098 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:46.098 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme1n1 : 0.81 346.52 21.66 0.00 0.00 180906.63 7864.32 202420.76 00:18:46.098 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme2n1 : 0.81 354.66 22.17 0.00 0.00 173340.39 8092.27 193302.71 00:18:46.098 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme3n1 : 0.81 355.33 22.21 0.00 0.00 169624.66 8377.21 186920.07 00:18:46.098 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme4n1 : 0.81 394.12 24.63 0.00 0.00 149875.53 5271.37 132211.76 00:18:46.098 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme5n1 : 0.81 373.79 23.36 0.00 0.00 154941.84 9346.00 165036.74 00:18:46.098 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme6n1 : 0.81 392.76 24.55 0.00 0.00 144628.07 10029.86 115799.26 00:18:46.098 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme7n1 : 0.82 392.17 24.51 0.00 0.00 141325.00 10257.81 110784.33 00:18:46.098 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme8n1 : 0.82 391.40 24.46 0.00 0.00 139392.04 10998.65 102122.18 00:18:46.098 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme9n1 : 0.82 390.61 24.41 0.00 0.00 136692.96 11910.46 97107.26 00:18:46.098 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:46.098 Verification LBA range: start 0x0 length 0x400 00:18:46.098 Nvme10n1 : 0.82 310.98 19.44 0.00 0.00 167379.98 3020.35 206979.78 00:18:46.098 =================================================================================================================== 00:18:46.098 Total : 3702.33 231.40 0.00 0.00 154898.31 3020.35 206979.78 00:18:46.357 18:06:55 -- target/shutdown.sh@113 -- # sleep 1 00:18:47.292 18:06:56 -- target/shutdown.sh@114 -- # kill -0 1000427 00:18:47.292 18:06:56 -- target/shutdown.sh@116 -- # stoptarget 00:18:47.292 18:06:56 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:47.292 18:06:56 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:47.550 18:06:56 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:47.550 18:06:56 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:47.550 18:06:56 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:47.550 18:06:56 -- nvmf/common.sh@117 -- # sync 00:18:47.550 18:06:56 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:47.550 18:06:56 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:47.550 18:06:56 -- nvmf/common.sh@120 -- # set +e 00:18:47.550 18:06:56 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:47.550 18:06:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:47.550 rmmod nvme_rdma 00:18:47.550 rmmod nvme_fabrics 00:18:47.550 18:06:56 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:47.550 18:06:56 -- nvmf/common.sh@124 -- # set -e 00:18:47.550 18:06:56 -- nvmf/common.sh@125 -- # return 0 00:18:47.550 18:06:56 -- nvmf/common.sh@478 -- # '[' -n 1000427 ']' 00:18:47.550 18:06:56 -- nvmf/common.sh@479 -- # killprocess 1000427 00:18:47.550 18:06:56 -- common/autotest_common.sh@946 -- # '[' -z 1000427 ']' 00:18:47.550 18:06:56 -- common/autotest_common.sh@950 -- # kill -0 1000427 00:18:47.550 18:06:56 -- common/autotest_common.sh@951 -- # uname 00:18:47.550 18:06:56 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:47.550 18:06:56 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1000427 00:18:47.550 18:06:56 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:18:47.550 18:06:56 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:18:47.550 18:06:56 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1000427' 00:18:47.550 killing process with pid 1000427 00:18:47.550 18:06:56 -- common/autotest_common.sh@965 -- # kill 1000427 00:18:47.550 18:06:56 -- common/autotest_common.sh@970 -- # wait 1000427 00:18:47.550 [2024-04-26 18:06:56.663726] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:48.119 18:06:57 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:48.119 18:06:57 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:48.119 00:18:48.119 real 0m5.735s 00:18:48.119 user 0m22.799s 00:18:48.119 sys 0m1.267s 00:18:48.119 18:06:57 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:48.119 18:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:48.119 ************************************ 00:18:48.119 END TEST nvmf_shutdown_tc2 00:18:48.119 ************************************ 00:18:48.119 18:06:57 -- target/shutdown.sh@149 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:18:48.119 18:06:57 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:18:48.119 18:06:57 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:48.119 18:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:48.119 ************************************ 00:18:48.119 START TEST nvmf_shutdown_tc3 00:18:48.119 ************************************ 00:18:48.119 18:06:57 -- common/autotest_common.sh@1121 -- # nvmf_shutdown_tc3 00:18:48.119 18:06:57 -- target/shutdown.sh@121 -- # starttarget 00:18:48.119 18:06:57 -- target/shutdown.sh@15 -- # nvmftestinit 00:18:48.119 18:06:57 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:48.119 18:06:57 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:48.119 18:06:57 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:48.119 18:06:57 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:48.119 18:06:57 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:48.119 18:06:57 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:48.119 18:06:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:48.119 18:06:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:48.119 18:06:57 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:48.119 18:06:57 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:48.119 18:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:48.119 18:06:57 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:48.119 18:06:57 -- nvmf/common.sh@291 -- # pci_devs=() 00:18:48.119 18:06:57 -- nvmf/common.sh@291 -- # local -a pci_devs 00:18:48.119 18:06:57 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:18:48.119 18:06:57 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:18:48.119 18:06:57 -- nvmf/common.sh@293 -- # pci_drivers=() 00:18:48.119 18:06:57 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:18:48.119 18:06:57 -- nvmf/common.sh@295 -- # net_devs=() 00:18:48.119 18:06:57 -- nvmf/common.sh@295 -- # local -ga net_devs 00:18:48.119 18:06:57 -- nvmf/common.sh@296 -- # e810=() 00:18:48.119 18:06:57 -- nvmf/common.sh@296 -- # local -ga e810 00:18:48.119 18:06:57 -- nvmf/common.sh@297 -- # x722=() 00:18:48.119 18:06:57 -- nvmf/common.sh@297 -- # local -ga x722 00:18:48.119 18:06:57 -- nvmf/common.sh@298 -- # mlx=() 00:18:48.119 18:06:57 -- nvmf/common.sh@298 -- # local -ga mlx 00:18:48.119 18:06:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:48.119 18:06:57 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:18:48.119 18:06:57 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:18:48.119 18:06:57 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:18:48.119 18:06:57 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:18:48.119 18:06:57 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:18:48.119 18:06:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:48.119 18:06:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:18:48.119 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:18:48.119 18:06:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:48.119 18:06:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:48.379 18:06:57 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:18:48.379 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:18:48.379 18:06:57 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:18:48.379 18:06:57 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.379 18:06:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.379 18:06:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:18:48.379 Found net devices under 0000:18:00.0: mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.379 18:06:57 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:48.379 18:06:57 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:48.379 18:06:57 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:18:48.379 Found net devices under 0000:18:00.1: mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:18:48.379 18:06:57 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@403 -- # is_hw=yes 00:18:48.379 18:06:57 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@409 -- # rdma_device_init 00:18:48.379 18:06:57 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:18:48.379 18:06:57 -- nvmf/common.sh@58 -- # uname 00:18:48.379 18:06:57 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:18:48.379 18:06:57 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:18:48.379 18:06:57 -- nvmf/common.sh@63 -- # modprobe ib_core 00:18:48.379 18:06:57 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:18:48.379 18:06:57 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:18:48.379 18:06:57 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:18:48.379 18:06:57 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:18:48.379 18:06:57 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:18:48.379 18:06:57 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:18:48.379 18:06:57 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:18:48.379 18:06:57 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:18:48.379 18:06:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:48.379 18:06:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:48.379 18:06:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:48.379 18:06:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:48.379 18:06:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@105 -- # continue 2 00:18:48.379 18:06:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@105 -- # continue 2 00:18:48.379 18:06:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:48.379 18:06:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:48.379 18:06:57 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:18:48.379 18:06:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:18:48.379 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:48.379 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:18:48.379 altname enp24s0f0np0 00:18:48.379 altname ens785f0np0 00:18:48.379 inet 192.168.100.8/24 scope global mlx_0_0 00:18:48.379 valid_lft forever preferred_lft forever 00:18:48.379 18:06:57 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:18:48.379 18:06:57 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:48.379 18:06:57 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:18:48.379 18:06:57 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:18:48.379 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:18:48.379 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:18:48.379 altname enp24s0f1np1 00:18:48.379 altname ens785f1np1 00:18:48.379 inet 192.168.100.9/24 scope global mlx_0_1 00:18:48.379 valid_lft forever preferred_lft forever 00:18:48.379 18:06:57 -- nvmf/common.sh@411 -- # return 0 00:18:48.379 18:06:57 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:18:48.379 18:06:57 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:18:48.379 18:06:57 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:18:48.379 18:06:57 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:18:48.379 18:06:57 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:18:48.379 18:06:57 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:18:48.379 18:06:57 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:18:48.379 18:06:57 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:18:48.379 18:06:57 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:18:48.379 18:06:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@105 -- # continue 2 00:18:48.379 18:06:57 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:18:48.379 18:06:57 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:18:48.379 18:06:57 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@105 -- # continue 2 00:18:48.379 18:06:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:48.379 18:06:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:48.379 18:06:57 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:18:48.379 18:06:57 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:18:48.379 18:06:57 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:18:48.379 18:06:57 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:18:48.379 192.168.100.9' 00:18:48.379 18:06:57 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:18:48.379 192.168.100.9' 00:18:48.379 18:06:57 -- nvmf/common.sh@446 -- # head -n 1 00:18:48.379 18:06:57 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:18:48.379 18:06:57 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:18:48.379 192.168.100.9' 00:18:48.379 18:06:57 -- nvmf/common.sh@447 -- # head -n 1 00:18:48.379 18:06:57 -- nvmf/common.sh@447 -- # tail -n +2 00:18:48.379 18:06:57 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:18:48.379 18:06:57 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:18:48.379 18:06:57 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:18:48.379 18:06:57 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:18:48.379 18:06:57 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:18:48.379 18:06:57 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:18:48.379 18:06:57 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:18:48.379 18:06:57 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:18:48.379 18:06:57 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:48.379 18:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:48.379 18:06:57 -- nvmf/common.sh@470 -- # nvmfpid=1001334 00:18:48.379 18:06:57 -- nvmf/common.sh@471 -- # waitforlisten 1001334 00:18:48.379 18:06:57 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:18:48.379 18:06:57 -- common/autotest_common.sh@827 -- # '[' -z 1001334 ']' 00:18:48.379 18:06:57 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:48.379 18:06:57 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:48.379 18:06:57 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:48.380 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:48.380 18:06:57 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:48.380 18:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:48.639 [2024-04-26 18:06:57.616815] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:48.639 [2024-04-26 18:06:57.616875] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:48.639 EAL: No free 2048 kB hugepages reported on node 1 00:18:48.639 [2024-04-26 18:06:57.691815] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:48.639 [2024-04-26 18:06:57.776464] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:48.639 [2024-04-26 18:06:57.776510] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:48.639 [2024-04-26 18:06:57.776519] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:18:48.639 [2024-04-26 18:06:57.776543] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:18:48.639 [2024-04-26 18:06:57.776550] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:48.639 [2024-04-26 18:06:57.776668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:48.639 [2024-04-26 18:06:57.776749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:48.639 [2024-04-26 18:06:57.776850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:48.639 [2024-04-26 18:06:57.776852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:49.575 18:06:58 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:49.575 18:06:58 -- common/autotest_common.sh@860 -- # return 0 00:18:49.575 18:06:58 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:18:49.575 18:06:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:49.575 18:06:58 -- common/autotest_common.sh@10 -- # set +x 00:18:49.575 18:06:58 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:49.575 18:06:58 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:18:49.575 18:06:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:49.575 18:06:58 -- common/autotest_common.sh@10 -- # set +x 00:18:49.575 [2024-04-26 18:06:58.515856] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xd1f7c0/0xd23cb0) succeed. 00:18:49.575 [2024-04-26 18:06:58.526498] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xd20e00/0xd65340) succeed. 00:18:49.575 18:06:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:49.575 18:06:58 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:18:49.575 18:06:58 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:18:49.575 18:06:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:49.575 18:06:58 -- common/autotest_common.sh@10 -- # set +x 00:18:49.575 18:06:58 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:49.575 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.575 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.575 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.575 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.575 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.575 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.575 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:18:49.576 18:06:58 -- target/shutdown.sh@28 -- # cat 00:18:49.576 18:06:58 -- target/shutdown.sh@35 -- # rpc_cmd 00:18:49.576 18:06:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:49.576 18:06:58 -- common/autotest_common.sh@10 -- # set +x 00:18:49.576 Malloc1 00:18:49.576 [2024-04-26 18:06:58.752327] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:18:49.835 Malloc2 00:18:49.835 Malloc3 00:18:49.835 Malloc4 00:18:49.835 Malloc5 00:18:49.835 Malloc6 00:18:49.835 Malloc7 00:18:50.095 Malloc8 00:18:50.095 Malloc9 00:18:50.095 Malloc10 00:18:50.095 18:06:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:50.095 18:06:59 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:18:50.095 18:06:59 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:50.095 18:06:59 -- common/autotest_common.sh@10 -- # set +x 00:18:50.095 18:06:59 -- target/shutdown.sh@125 -- # perfpid=1001572 00:18:50.095 18:06:59 -- target/shutdown.sh@126 -- # waitforlisten 1001572 /var/tmp/bdevperf.sock 00:18:50.095 18:06:59 -- common/autotest_common.sh@827 -- # '[' -z 1001572 ']' 00:18:50.095 18:06:59 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:50.095 18:06:59 -- common/autotest_common.sh@832 -- # local max_retries=100 00:18:50.095 18:06:59 -- target/shutdown.sh@124 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:18:50.095 18:06:59 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:50.095 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:50.095 18:06:59 -- target/shutdown.sh@124 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:18:50.095 18:06:59 -- common/autotest_common.sh@836 -- # xtrace_disable 00:18:50.095 18:06:59 -- common/autotest_common.sh@10 -- # set +x 00:18:50.095 18:06:59 -- nvmf/common.sh@521 -- # config=() 00:18:50.095 18:06:59 -- nvmf/common.sh@521 -- # local subsystem config 00:18:50.095 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.095 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.095 { 00:18:50.095 "params": { 00:18:50.095 "name": "Nvme$subsystem", 00:18:50.095 "trtype": "$TEST_TRANSPORT", 00:18:50.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.095 "adrfam": "ipv4", 00:18:50.095 "trsvcid": "$NVMF_PORT", 00:18:50.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.095 "hdgst": ${hdgst:-false}, 00:18:50.095 "ddgst": ${ddgst:-false} 00:18:50.095 }, 00:18:50.095 "method": "bdev_nvme_attach_controller" 00:18:50.095 } 00:18:50.095 EOF 00:18:50.095 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 [2024-04-26 18:06:59.260737] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:18:50.096 [2024-04-26 18:06:59.260800] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1001572 ] 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.096 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.096 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.096 { 00:18:50.096 "params": { 00:18:50.096 "name": "Nvme$subsystem", 00:18:50.096 "trtype": "$TEST_TRANSPORT", 00:18:50.096 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.096 "adrfam": "ipv4", 00:18:50.096 "trsvcid": "$NVMF_PORT", 00:18:50.096 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.096 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.096 "hdgst": ${hdgst:-false}, 00:18:50.096 "ddgst": ${ddgst:-false} 00:18:50.096 }, 00:18:50.096 "method": "bdev_nvme_attach_controller" 00:18:50.096 } 00:18:50.096 EOF 00:18:50.096 )") 00:18:50.355 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.355 18:06:59 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:18:50.355 18:06:59 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:18:50.355 { 00:18:50.355 "params": { 00:18:50.355 "name": "Nvme$subsystem", 00:18:50.355 "trtype": "$TEST_TRANSPORT", 00:18:50.355 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:50.355 "adrfam": "ipv4", 00:18:50.355 "trsvcid": "$NVMF_PORT", 00:18:50.355 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:50.355 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:50.355 "hdgst": ${hdgst:-false}, 00:18:50.355 "ddgst": ${ddgst:-false} 00:18:50.355 }, 00:18:50.355 "method": "bdev_nvme_attach_controller" 00:18:50.355 } 00:18:50.355 EOF 00:18:50.355 )") 00:18:50.355 EAL: No free 2048 kB hugepages reported on node 1 00:18:50.355 18:06:59 -- nvmf/common.sh@543 -- # cat 00:18:50.355 18:06:59 -- nvmf/common.sh@545 -- # jq . 00:18:50.355 18:06:59 -- nvmf/common.sh@546 -- # IFS=, 00:18:50.355 18:06:59 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:18:50.355 "params": { 00:18:50.355 "name": "Nvme1", 00:18:50.355 "trtype": "rdma", 00:18:50.355 "traddr": "192.168.100.8", 00:18:50.355 "adrfam": "ipv4", 00:18:50.355 "trsvcid": "4420", 00:18:50.355 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:50.355 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:50.355 "hdgst": false, 00:18:50.355 "ddgst": false 00:18:50.355 }, 00:18:50.355 "method": "bdev_nvme_attach_controller" 00:18:50.355 },{ 00:18:50.355 "params": { 00:18:50.355 "name": "Nvme2", 00:18:50.355 "trtype": "rdma", 00:18:50.355 "traddr": "192.168.100.8", 00:18:50.355 "adrfam": "ipv4", 00:18:50.355 "trsvcid": "4420", 00:18:50.355 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:18:50.355 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:18:50.355 "hdgst": false, 00:18:50.355 "ddgst": false 00:18:50.355 }, 00:18:50.355 "method": "bdev_nvme_attach_controller" 00:18:50.355 },{ 00:18:50.355 "params": { 00:18:50.355 "name": "Nvme3", 00:18:50.355 "trtype": "rdma", 00:18:50.355 "traddr": "192.168.100.8", 00:18:50.355 "adrfam": "ipv4", 00:18:50.355 "trsvcid": "4420", 00:18:50.355 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:18:50.355 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:18:50.355 "hdgst": false, 00:18:50.355 "ddgst": false 00:18:50.355 }, 00:18:50.355 "method": "bdev_nvme_attach_controller" 00:18:50.355 },{ 00:18:50.355 "params": { 00:18:50.355 "name": "Nvme4", 00:18:50.355 "trtype": "rdma", 00:18:50.355 "traddr": "192.168.100.8", 00:18:50.355 "adrfam": "ipv4", 00:18:50.355 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme5", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme6", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme7", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme8", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme9", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 },{ 00:18:50.356 "params": { 00:18:50.356 "name": "Nvme10", 00:18:50.356 "trtype": "rdma", 00:18:50.356 "traddr": "192.168.100.8", 00:18:50.356 "adrfam": "ipv4", 00:18:50.356 "trsvcid": "4420", 00:18:50.356 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:18:50.356 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:18:50.356 "hdgst": false, 00:18:50.356 "ddgst": false 00:18:50.356 }, 00:18:50.356 "method": "bdev_nvme_attach_controller" 00:18:50.356 }' 00:18:50.356 [2024-04-26 18:06:59.335326] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:50.356 [2024-04-26 18:06:59.416154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:51.291 Running I/O for 10 seconds... 00:18:51.291 18:07:00 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:18:51.291 18:07:00 -- common/autotest_common.sh@860 -- # return 0 00:18:51.292 18:07:00 -- target/shutdown.sh@127 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:18:51.292 18:07:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:51.292 18:07:00 -- common/autotest_common.sh@10 -- # set +x 00:18:51.292 18:07:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:51.292 18:07:00 -- target/shutdown.sh@130 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:51.292 18:07:00 -- target/shutdown.sh@132 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:18:51.292 18:07:00 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:18:51.292 18:07:00 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:18:51.292 18:07:00 -- target/shutdown.sh@57 -- # local ret=1 00:18:51.292 18:07:00 -- target/shutdown.sh@58 -- # local i 00:18:51.292 18:07:00 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:18:51.292 18:07:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:51.292 18:07:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:51.292 18:07:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:51.292 18:07:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:51.292 18:07:00 -- common/autotest_common.sh@10 -- # set +x 00:18:51.551 18:07:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:51.551 18:07:00 -- target/shutdown.sh@60 -- # read_io_count=27 00:18:51.551 18:07:00 -- target/shutdown.sh@63 -- # '[' 27 -ge 100 ']' 00:18:51.551 18:07:00 -- target/shutdown.sh@67 -- # sleep 0.25 00:18:51.809 18:07:00 -- target/shutdown.sh@59 -- # (( i-- )) 00:18:51.809 18:07:00 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:18:51.809 18:07:00 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:18:51.809 18:07:00 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:18:51.809 18:07:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:18:51.809 18:07:00 -- common/autotest_common.sh@10 -- # set +x 00:18:52.068 18:07:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:18:52.068 18:07:01 -- target/shutdown.sh@60 -- # read_io_count=183 00:18:52.068 18:07:01 -- target/shutdown.sh@63 -- # '[' 183 -ge 100 ']' 00:18:52.068 18:07:01 -- target/shutdown.sh@64 -- # ret=0 00:18:52.068 18:07:01 -- target/shutdown.sh@65 -- # break 00:18:52.068 18:07:01 -- target/shutdown.sh@69 -- # return 0 00:18:52.068 18:07:01 -- target/shutdown.sh@135 -- # killprocess 1001334 00:18:52.068 18:07:01 -- common/autotest_common.sh@946 -- # '[' -z 1001334 ']' 00:18:52.068 18:07:01 -- common/autotest_common.sh@950 -- # kill -0 1001334 00:18:52.068 18:07:01 -- common/autotest_common.sh@951 -- # uname 00:18:52.068 18:07:01 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:18:52.068 18:07:01 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1001334 00:18:52.068 18:07:01 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:18:52.068 18:07:01 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:18:52.068 18:07:01 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1001334' 00:18:52.068 killing process with pid 1001334 00:18:52.068 18:07:01 -- common/autotest_common.sh@965 -- # kill 1001334 00:18:52.068 18:07:01 -- common/autotest_common.sh@970 -- # wait 1001334 00:18:52.068 [2024-04-26 18:07:01.206615] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:18:52.636 18:07:01 -- target/shutdown.sh@136 -- # nvmfpid= 00:18:52.636 18:07:01 -- target/shutdown.sh@139 -- # sleep 1 00:18:53.206 [2024-04-26 18:07:02.133379] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257b00 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.135873] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192578c0 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.137915] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257680 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.140254] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257440 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.142698] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019257200 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.145310] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256fc0 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.147750] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256d80 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.150370] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256b40 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.150460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37888 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b32fa00 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:38016 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b31f980 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38144 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b30f900 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38272 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ff880 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38400 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2ef800 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38528 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2df780 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2cf700 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:38784 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2bf680 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:38912 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b2af600 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:39040 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b29f580 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b28f500 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39296 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b27f480 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b26f400 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39552 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b25f380 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b24f300 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.150969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b23f280 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.150983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b22f200 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.151015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40064 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b21f180 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.151048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b20f100 len:0x10000 key:0x183600 00:18:53.206 [2024-04-26 18:07:02.151080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:40320 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5f0000 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.151112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:40448 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5dff80 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.151148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5cff00 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.151181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:40704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b5bfe80 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.151214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.151233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:40832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b0efe00 len:0x10000 key:0x183400 00:18:53.206 [2024-04-26 18:07:02.151246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153531] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x200019256900 was disconnected and freed. reset controller. 00:18:53.206 [2024-04-26 18:07:02.153688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:24576 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b49fb80 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:24704 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b48fb00 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:24832 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b47fa80 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24960 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b46fa00 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25088 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b45f980 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:25216 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b44f900 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b43f880 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b42f800 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25600 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b41f780 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25728 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b40f700 len:0x10000 key:0x183a00 00:18:53.206 [2024-04-26 18:07:02.153980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.153996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:25856 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7f0000 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:25984 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7dff80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:26112 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7cff00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26240 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7bfe80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:26368 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b7afe00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26496 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b79fd80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:26624 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b78fd00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26752 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b77fc80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26880 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b76fc00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:27008 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b75fb80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:27136 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b74fb00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27264 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b73fa80 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:27392 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b72fa00 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27520 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b71f980 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:27648 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b70f900 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:27776 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ff880 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27904 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6ef800 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28032 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6df780 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28160 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6cf700 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6bf680 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28416 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b6af600 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28544 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b69f580 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.206 [2024-04-26 18:07:02.154658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:28672 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b68f500 len:0x10000 key:0x183e00 00:18:53.206 [2024-04-26 18:07:02.154672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b67f480 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28928 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b66f400 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b65f380 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:29184 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b64f300 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:29312 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b63f280 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:29440 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b62f200 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:29568 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b61f180 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:29696 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b60f100 len:0x10000 key:0x183e00 00:18:53.207 [2024-04-26 18:07:02.154913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:29824 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9f0000 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.154943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:29952 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9dff80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.154972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.154988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:30080 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9cff00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:30208 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9bfe80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30336 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b9afe00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:30464 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b99fd80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:30592 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b98fd00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:30720 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b97fc80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b96fc00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:30976 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b95fb80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:31104 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b94fb00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31232 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b93fa80 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:31360 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b92fa00 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:31488 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b91f980 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:31616 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b90f900 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:31744 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ff880 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31872 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8ef800 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:32000 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8df780 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32128 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8cf700 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:32256 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8bf680 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32384 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b8af600 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b89f580 len:0x10000 key:0x183d00 00:18:53.207 [2024-04-26 18:07:02.155577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.155594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:32640 len:128 SGL KEYED DATA BLOCK ADDRESS 0x20001b4afc00 len:0x10000 key:0x183a00 00:18:53.207 [2024-04-26 18:07:02.155607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:32728 cdw0:8c28f4d0 sqhd:c46e p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.158522] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192566c0 was disconnected and freed. reset controller. 00:18:53.207 [2024-04-26 18:07:02.158617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.158636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.158653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.158669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.158684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.158698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.158713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.158727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.161183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.161203] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:18:53.207 [2024-04-26 18:07:02.161220] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.161242] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.161257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.161272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.161286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.161300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.161316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.161330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.161351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.163254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.163295] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:18:53.207 [2024-04-26 18:07:02.163332] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.163388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.163421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.163453] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.163484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.163516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.163546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.163579] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.163609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.165881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.165920] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:18:53.207 [2024-04-26 18:07:02.165950] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.165992] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.166025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.166058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.166088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.166120] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.166151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.166184] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.166214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.168173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.168204] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:53.207 [2024-04-26 18:07:02.168217] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.168236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.168251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.168266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.168283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.168298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.168311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.168325] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.168354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.170431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.170449] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:18:53.207 [2024-04-26 18:07:02.170463] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.170482] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.170496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.170511] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.170524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.170539] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.170552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.170566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.170579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.172749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.172787] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:18:53.207 [2024-04-26 18:07:02.172817] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.172861] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.172893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.172925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.172956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.172989] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.173019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.173051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.173089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.175131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.207 [2024-04-26 18:07:02.175150] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:18:53.207 [2024-04-26 18:07:02.175163] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.207 [2024-04-26 18:07:02.175182] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.175196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.175211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.175225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.175240] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.207 [2024-04-26 18:07:02.175253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.207 [2024-04-26 18:07:02.175267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.175280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.177202] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.208 [2024-04-26 18:07:02.177243] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:18:53.208 [2024-04-26 18:07:02.177273] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.177317] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.177360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.177393] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.177424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.177457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.177488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.177520] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.177551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.179472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.208 [2024-04-26 18:07:02.179491] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:18:53.208 [2024-04-26 18:07:02.179504] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.179523] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.179541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.179555] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.179569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.179584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.179597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.179611] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:18:53.208 [2024-04-26 18:07:02.179624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:4228 cdw0:0 sqhd:6700 p:0 m:0 dnr:0 00:18:53.208 [2024-04-26 18:07:02.199148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:18:53.208 [2024-04-26 18:07:02.199201] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:18:53.208 [2024-04-26 18:07:02.199233] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.201765] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201792] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201807] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201822] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201837] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201854] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:18:53.208 [2024-04-26 18:07:02.201936] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.201961] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.201979] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.201999] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:18:53.208 [2024-04-26 18:07:02.202165] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:18:53.208 [2024-04-26 18:07:02.202183] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:18:53.208 [2024-04-26 18:07:02.202199] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:18:53.208 [2024-04-26 18:07:02.202214] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:18:53.208 [2024-04-26 18:07:02.225329] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.225401] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.225430] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192bd440 00:18:53.208 [2024-04-26 18:07:02.225560] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.225603] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.225640] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192c60c0 00:18:53.208 [2024-04-26 18:07:02.225785] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.225819] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.225843] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192d9c00 00:18:53.208 [2024-04-26 18:07:02.225991] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.226033] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.226057] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ba540 00:18:53.208 [2024-04-26 18:07:02.226207] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.226243] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.226268] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192e5380 00:18:53.208 [2024-04-26 18:07:02.226407] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.226441] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.226466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:18:53.208 task offset: 40960 on job bdev=Nvme6n1 fails 00:18:53.208 00:18:53.208 Latency(us) 00:18:53.208 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:53.208 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme1n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme1n1 : 1.92 146.11 9.13 33.40 0.00 353009.60 7693.36 1064988.49 00:18:53.208 Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme2n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme2n1 : 1.92 149.13 9.32 33.37 0.00 344236.75 13164.19 1064988.49 00:18:53.208 Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme3n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme3n1 : 1.92 150.08 9.38 33.35 0.00 339822.94 19375.86 1064988.49 00:18:53.208 Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme4n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme4n1 : 1.92 153.64 9.60 33.33 0.00 330665.31 5584.81 1064988.49 00:18:53.208 Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme5n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme5n1 : 1.92 141.58 8.85 33.31 0.00 350388.97 34192.70 1064988.49 00:18:53.208 Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme6n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme6n1 : 1.92 142.02 8.88 33.29 0.00 346318.57 36472.21 1057694.05 00:18:53.208 Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme7n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme7n1 : 1.92 149.74 9.36 33.28 0.00 328687.65 45362.31 1057694.05 00:18:53.208 Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme8n1 ended in about 1.92 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme8n1 : 1.92 146.02 9.13 33.26 0.00 332426.34 49921.34 1050399.61 00:18:53.208 Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme9n1 ended in about 1.93 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme9n1 : 1.93 137.11 8.57 33.24 0.00 342090.28 35788.35 1057694.05 00:18:53.208 Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:18:53.208 Job: Nvme10n1 ended in about 1.91 seconds with error 00:18:53.208 Verification LBA range: start 0x0 length 0x400 00:18:53.208 Nvme10n1 : 1.91 100.67 6.29 33.56 0.00 438645.98 62002.75 1094166.26 00:18:53.208 =================================================================================================================== 00:18:53.208 Total : 1416.10 88.51 333.39 0.00 348189.60 5584.81 1094166.26 00:18:53.208 [2024-04-26 18:07:02.251509] app.c: 966:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:18:53.208 [2024-04-26 18:07:02.251548] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.251575] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.251584] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192b54c0 00:18:53.208 [2024-04-26 18:07:02.251770] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.251782] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.251789] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001929c140 00:18:53.208 [2024-04-26 18:07:02.251857] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.251868] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.251875] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x200019298cc0 00:18:53.208 [2024-04-26 18:07:02.251938] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:18:53.208 [2024-04-26 18:07:02.251948] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:18:53.208 [2024-04-26 18:07:02.251956] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x20001928f280 00:18:53.777 18:07:02 -- target/shutdown.sh@142 -- # kill -9 1001572 00:18:53.777 18:07:02 -- target/shutdown.sh@144 -- # stoptarget 00:18:53.777 18:07:02 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:18:53.777 18:07:02 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:18:53.777 18:07:02 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:18:53.777 18:07:02 -- target/shutdown.sh@45 -- # nvmftestfini 00:18:53.777 18:07:02 -- nvmf/common.sh@477 -- # nvmfcleanup 00:18:53.777 18:07:02 -- nvmf/common.sh@117 -- # sync 00:18:53.777 18:07:02 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:18:53.777 18:07:02 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:18:53.777 18:07:02 -- nvmf/common.sh@120 -- # set +e 00:18:53.777 18:07:02 -- nvmf/common.sh@121 -- # for i in {1..20} 00:18:53.777 18:07:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:18:53.777 rmmod nvme_rdma 00:18:53.777 rmmod nvme_fabrics 00:18:53.777 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh: line 121: 1001572 Killed $rootdir/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") -q 64 -o 65536 -w verify -t 10 00:18:53.777 18:07:02 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:18:53.777 18:07:02 -- nvmf/common.sh@124 -- # set -e 00:18:53.777 18:07:02 -- nvmf/common.sh@125 -- # return 0 00:18:53.777 18:07:02 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:18:53.777 18:07:02 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:18:53.777 18:07:02 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:18:53.777 00:18:53.777 real 0m5.440s 00:18:53.777 user 0m18.386s 00:18:53.777 sys 0m1.411s 00:18:53.777 18:07:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:53.777 18:07:02 -- common/autotest_common.sh@10 -- # set +x 00:18:53.777 ************************************ 00:18:53.777 END TEST nvmf_shutdown_tc3 00:18:53.777 ************************************ 00:18:53.777 18:07:02 -- target/shutdown.sh@151 -- # trap - SIGINT SIGTERM EXIT 00:18:53.777 00:18:53.777 real 0m24.857s 00:18:53.777 user 1m13.089s 00:18:53.777 sys 0m8.787s 00:18:53.777 18:07:02 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:53.777 18:07:02 -- common/autotest_common.sh@10 -- # set +x 00:18:53.777 ************************************ 00:18:53.777 END TEST nvmf_shutdown 00:18:53.777 ************************************ 00:18:53.777 18:07:02 -- nvmf/nvmf.sh@84 -- # timing_exit target 00:18:53.777 18:07:02 -- common/autotest_common.sh@726 -- # xtrace_disable 00:18:53.777 18:07:02 -- common/autotest_common.sh@10 -- # set +x 00:18:53.777 18:07:02 -- nvmf/nvmf.sh@86 -- # timing_enter host 00:18:53.777 18:07:02 -- common/autotest_common.sh@720 -- # xtrace_disable 00:18:53.777 18:07:02 -- common/autotest_common.sh@10 -- # set +x 00:18:53.777 18:07:02 -- nvmf/nvmf.sh@88 -- # [[ 0 -eq 0 ]] 00:18:53.777 18:07:02 -- nvmf/nvmf.sh@89 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:18:53.777 18:07:02 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:18:53.777 18:07:02 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:53.777 18:07:02 -- common/autotest_common.sh@10 -- # set +x 00:18:54.037 ************************************ 00:18:54.037 START TEST nvmf_multicontroller 00:18:54.037 ************************************ 00:18:54.037 18:07:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=rdma 00:18:54.037 * Looking for test storage... 00:18:54.037 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:54.037 18:07:03 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:54.037 18:07:03 -- nvmf/common.sh@7 -- # uname -s 00:18:54.037 18:07:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:54.037 18:07:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:54.037 18:07:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:54.037 18:07:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:54.037 18:07:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:54.037 18:07:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:54.037 18:07:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:54.037 18:07:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:54.037 18:07:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:54.037 18:07:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:54.037 18:07:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:18:54.037 18:07:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:18:54.037 18:07:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:54.037 18:07:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:54.037 18:07:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:54.037 18:07:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:54.037 18:07:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:54.037 18:07:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:54.037 18:07:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:54.037 18:07:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:54.037 18:07:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.038 18:07:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.038 18:07:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.038 18:07:03 -- paths/export.sh@5 -- # export PATH 00:18:54.038 18:07:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.038 18:07:03 -- nvmf/common.sh@47 -- # : 0 00:18:54.038 18:07:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:54.038 18:07:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:54.038 18:07:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:54.038 18:07:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:54.038 18:07:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:54.038 18:07:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:54.038 18:07:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:54.038 18:07:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:54.038 18:07:03 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:54.038 18:07:03 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:54.038 18:07:03 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:18:54.038 18:07:03 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:18:54.038 18:07:03 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:54.038 18:07:03 -- host/multicontroller.sh@18 -- # '[' rdma == rdma ']' 00:18:54.038 18:07:03 -- host/multicontroller.sh@19 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:18:54.038 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:18:54.038 18:07:03 -- host/multicontroller.sh@20 -- # exit 0 00:18:54.038 00:18:54.038 real 0m0.135s 00:18:54.038 user 0m0.065s 00:18:54.038 sys 0m0.082s 00:18:54.038 18:07:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:18:54.038 18:07:03 -- common/autotest_common.sh@10 -- # set +x 00:18:54.038 ************************************ 00:18:54.038 END TEST nvmf_multicontroller 00:18:54.038 ************************************ 00:18:54.038 18:07:03 -- nvmf/nvmf.sh@90 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:18:54.038 18:07:03 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:18:54.038 18:07:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:18:54.038 18:07:03 -- common/autotest_common.sh@10 -- # set +x 00:18:54.297 ************************************ 00:18:54.297 START TEST nvmf_aer 00:18:54.297 ************************************ 00:18:54.297 18:07:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=rdma 00:18:54.297 * Looking for test storage... 00:18:54.297 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:18:54.297 18:07:03 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:18:54.297 18:07:03 -- nvmf/common.sh@7 -- # uname -s 00:18:54.297 18:07:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:54.297 18:07:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:54.297 18:07:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:54.297 18:07:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:54.297 18:07:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:54.297 18:07:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:54.297 18:07:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:54.297 18:07:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:54.297 18:07:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:54.297 18:07:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:54.297 18:07:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:18:54.297 18:07:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:18:54.297 18:07:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:54.297 18:07:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:54.297 18:07:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:54.297 18:07:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:18:54.297 18:07:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:18:54.556 18:07:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:54.556 18:07:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:54.556 18:07:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:54.556 18:07:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.556 18:07:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.556 18:07:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.556 18:07:03 -- paths/export.sh@5 -- # export PATH 00:18:54.556 18:07:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:54.556 18:07:03 -- nvmf/common.sh@47 -- # : 0 00:18:54.556 18:07:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:18:54.556 18:07:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:18:54.556 18:07:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:18:54.556 18:07:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:54.556 18:07:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:54.556 18:07:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:18:54.556 18:07:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:18:54.556 18:07:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:18:54.556 18:07:03 -- host/aer.sh@11 -- # nvmftestinit 00:18:54.556 18:07:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:18:54.556 18:07:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:54.556 18:07:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:18:54.556 18:07:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:18:54.556 18:07:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:18:54.556 18:07:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:54.556 18:07:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:54.556 18:07:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:54.556 18:07:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:18:54.556 18:07:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:18:54.556 18:07:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:18:54.556 18:07:03 -- common/autotest_common.sh@10 -- # set +x 00:19:01.121 18:07:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:01.121 18:07:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:01.121 18:07:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:01.121 18:07:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:01.121 18:07:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:01.121 18:07:09 -- nvmf/common.sh@295 -- # net_devs=() 00:19:01.121 18:07:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@296 -- # e810=() 00:19:01.121 18:07:09 -- nvmf/common.sh@296 -- # local -ga e810 00:19:01.121 18:07:09 -- nvmf/common.sh@297 -- # x722=() 00:19:01.121 18:07:09 -- nvmf/common.sh@297 -- # local -ga x722 00:19:01.121 18:07:09 -- nvmf/common.sh@298 -- # mlx=() 00:19:01.121 18:07:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:01.121 18:07:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:01.121 18:07:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:01.121 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:01.121 18:07:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:01.121 18:07:09 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:01.121 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:01.121 18:07:09 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:01.121 18:07:09 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.121 18:07:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.121 18:07:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:01.121 Found net devices under 0000:18:00.0: mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:01.121 18:07:09 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:01.121 18:07:09 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:01.121 Found net devices under 0000:18:00.1: mlx_0_1 00:19:01.121 18:07:09 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:01.121 18:07:09 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:01.121 18:07:09 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:01.121 18:07:09 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:01.121 18:07:09 -- nvmf/common.sh@58 -- # uname 00:19:01.121 18:07:09 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:01.121 18:07:09 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:01.121 18:07:09 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:01.121 18:07:09 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:01.121 18:07:09 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:01.121 18:07:09 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:01.121 18:07:09 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:01.121 18:07:09 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:01.121 18:07:09 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:01.121 18:07:09 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:01.121 18:07:09 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:01.121 18:07:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:01.121 18:07:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:01.121 18:07:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@105 -- # continue 2 00:19:01.121 18:07:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:01.121 18:07:09 -- nvmf/common.sh@105 -- # continue 2 00:19:01.121 18:07:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:01.121 18:07:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.121 18:07:09 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:01.121 18:07:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:01.121 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:01.121 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:01.121 altname enp24s0f0np0 00:19:01.121 altname ens785f0np0 00:19:01.121 inet 192.168.100.8/24 scope global mlx_0_0 00:19:01.121 valid_lft forever preferred_lft forever 00:19:01.121 18:07:09 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:01.121 18:07:09 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:01.121 18:07:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.121 18:07:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.121 18:07:09 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:01.121 18:07:09 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:01.121 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:01.121 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:01.121 altname enp24s0f1np1 00:19:01.121 altname ens785f1np1 00:19:01.121 inet 192.168.100.9/24 scope global mlx_0_1 00:19:01.121 valid_lft forever preferred_lft forever 00:19:01.121 18:07:09 -- nvmf/common.sh@411 -- # return 0 00:19:01.121 18:07:09 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:01.121 18:07:09 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:01.121 18:07:09 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:01.121 18:07:09 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:01.121 18:07:09 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:01.121 18:07:09 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:01.121 18:07:09 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:01.121 18:07:09 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:01.121 18:07:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:01.121 18:07:09 -- nvmf/common.sh@105 -- # continue 2 00:19:01.121 18:07:09 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:01.121 18:07:09 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:01.121 18:07:09 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:01.122 18:07:09 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:01.122 18:07:09 -- nvmf/common.sh@105 -- # continue 2 00:19:01.122 18:07:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:01.122 18:07:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:01.122 18:07:09 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.122 18:07:09 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:01.122 18:07:09 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:01.122 18:07:09 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:01.122 18:07:09 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:01.122 18:07:09 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:01.122 192.168.100.9' 00:19:01.122 18:07:09 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:01.122 192.168.100.9' 00:19:01.122 18:07:09 -- nvmf/common.sh@446 -- # head -n 1 00:19:01.122 18:07:09 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:01.122 18:07:09 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:01.122 192.168.100.9' 00:19:01.122 18:07:09 -- nvmf/common.sh@447 -- # head -n 1 00:19:01.122 18:07:09 -- nvmf/common.sh@447 -- # tail -n +2 00:19:01.122 18:07:09 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:01.122 18:07:09 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:01.122 18:07:09 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:01.122 18:07:09 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:01.122 18:07:09 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:01.122 18:07:09 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:01.122 18:07:09 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:19:01.122 18:07:09 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:01.122 18:07:09 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:01.122 18:07:09 -- common/autotest_common.sh@10 -- # set +x 00:19:01.122 18:07:09 -- nvmf/common.sh@470 -- # nvmfpid=1005130 00:19:01.122 18:07:09 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:01.122 18:07:09 -- nvmf/common.sh@471 -- # waitforlisten 1005130 00:19:01.122 18:07:09 -- common/autotest_common.sh@827 -- # '[' -z 1005130 ']' 00:19:01.122 18:07:09 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:01.122 18:07:09 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:01.122 18:07:09 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:01.122 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:01.122 18:07:09 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:01.122 18:07:09 -- common/autotest_common.sh@10 -- # set +x 00:19:01.122 [2024-04-26 18:07:10.028133] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:01.122 [2024-04-26 18:07:10.028195] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:01.122 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.122 [2024-04-26 18:07:10.103780] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:01.122 [2024-04-26 18:07:10.200414] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:01.122 [2024-04-26 18:07:10.200461] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:01.122 [2024-04-26 18:07:10.200471] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:01.122 [2024-04-26 18:07:10.200480] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:01.122 [2024-04-26 18:07:10.200487] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:01.122 [2024-04-26 18:07:10.200549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:01.122 [2024-04-26 18:07:10.200615] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:01.122 [2024-04-26 18:07:10.200694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:01.122 [2024-04-26 18:07:10.200695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:01.688 18:07:10 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:01.688 18:07:10 -- common/autotest_common.sh@860 -- # return 0 00:19:01.688 18:07:10 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:01.688 18:07:10 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:01.688 18:07:10 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 18:07:10 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:01.946 18:07:10 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:01.946 18:07:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:10 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 [2024-04-26 18:07:10.943451] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x5444d0/0x5489c0) succeed. 00:19:01.946 [2024-04-26 18:07:10.954136] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x545b10/0x58a050) succeed. 00:19:01.946 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:01.946 18:07:11 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:19:01.946 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 Malloc0 00:19:01.946 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:01.946 18:07:11 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:19:01.946 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:01.946 18:07:11 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:01.946 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:01.946 18:07:11 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:01.946 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:01.946 [2024-04-26 18:07:11.134219] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:01.946 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:01.946 18:07:11 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:19:01.946 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:01.946 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.204 [2024-04-26 18:07:11.141847] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:19:02.204 [ 00:19:02.204 { 00:19:02.204 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:19:02.204 "subtype": "Discovery", 00:19:02.204 "listen_addresses": [], 00:19:02.204 "allow_any_host": true, 00:19:02.204 "hosts": [] 00:19:02.204 }, 00:19:02.204 { 00:19:02.204 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:02.204 "subtype": "NVMe", 00:19:02.204 "listen_addresses": [ 00:19:02.204 { 00:19:02.204 "transport": "RDMA", 00:19:02.204 "trtype": "RDMA", 00:19:02.204 "adrfam": "IPv4", 00:19:02.204 "traddr": "192.168.100.8", 00:19:02.204 "trsvcid": "4420" 00:19:02.204 } 00:19:02.204 ], 00:19:02.204 "allow_any_host": true, 00:19:02.204 "hosts": [], 00:19:02.204 "serial_number": "SPDK00000000000001", 00:19:02.204 "model_number": "SPDK bdev Controller", 00:19:02.204 "max_namespaces": 2, 00:19:02.204 "min_cntlid": 1, 00:19:02.204 "max_cntlid": 65519, 00:19:02.204 "namespaces": [ 00:19:02.204 { 00:19:02.204 "nsid": 1, 00:19:02.204 "bdev_name": "Malloc0", 00:19:02.204 "name": "Malloc0", 00:19:02.204 "nguid": "071A0AC9460D4E1196CE5C4431F5E590", 00:19:02.204 "uuid": "071a0ac9-460d-4e11-96ce-5c4431f5e590" 00:19:02.204 } 00:19:02.204 ] 00:19:02.204 } 00:19:02.204 ] 00:19:02.204 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.204 18:07:11 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:19:02.204 18:07:11 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:19:02.204 18:07:11 -- host/aer.sh@33 -- # aerpid=1005338 00:19:02.204 18:07:11 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:19:02.204 18:07:11 -- common/autotest_common.sh@1261 -- # local i=0 00:19:02.204 18:07:11 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:19:02.204 18:07:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1263 -- # '[' 0 -lt 200 ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1264 -- # i=1 00:19:02.204 18:07:11 -- common/autotest_common.sh@1265 -- # sleep 0.1 00:19:02.204 EAL: No free 2048 kB hugepages reported on node 1 00:19:02.204 18:07:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1263 -- # '[' 1 -lt 200 ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1264 -- # i=2 00:19:02.204 18:07:11 -- common/autotest_common.sh@1265 -- # sleep 0.1 00:19:02.204 18:07:11 -- common/autotest_common.sh@1262 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1268 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:19:02.204 18:07:11 -- common/autotest_common.sh@1272 -- # return 0 00:19:02.204 18:07:11 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:19:02.204 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.204 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 Malloc1 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:19:02.463 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.463 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:19:02.463 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.463 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 [ 00:19:02.463 { 00:19:02.463 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:19:02.463 "subtype": "Discovery", 00:19:02.463 "listen_addresses": [], 00:19:02.463 "allow_any_host": true, 00:19:02.463 "hosts": [] 00:19:02.463 }, 00:19:02.463 { 00:19:02.463 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:02.463 "subtype": "NVMe", 00:19:02.463 "listen_addresses": [ 00:19:02.463 { 00:19:02.463 "transport": "RDMA", 00:19:02.463 "trtype": "RDMA", 00:19:02.463 "adrfam": "IPv4", 00:19:02.463 "traddr": "192.168.100.8", 00:19:02.463 "trsvcid": "4420" 00:19:02.463 } 00:19:02.463 ], 00:19:02.463 "allow_any_host": true, 00:19:02.463 "hosts": [], 00:19:02.463 "serial_number": "SPDK00000000000001", 00:19:02.463 "model_number": "SPDK bdev Controller", 00:19:02.463 "max_namespaces": 2, 00:19:02.463 "min_cntlid": 1, 00:19:02.463 "max_cntlid": 65519, 00:19:02.463 "namespaces": [ 00:19:02.463 { 00:19:02.463 "nsid": 1, 00:19:02.463 "bdev_name": "Malloc0", 00:19:02.463 "name": "Malloc0", 00:19:02.463 "nguid": "071A0AC9460D4E1196CE5C4431F5E590", 00:19:02.463 "uuid": "071a0ac9-460d-4e11-96ce-5c4431f5e590" 00:19:02.463 }, 00:19:02.463 { 00:19:02.463 "nsid": 2, 00:19:02.463 "bdev_name": "Malloc1", 00:19:02.463 "name": "Malloc1", 00:19:02.463 "nguid": "B9DC3A36C2AA48219505DCDD9022428C", 00:19:02.463 "uuid": "b9dc3a36-c2aa-4821-9505-dcdd9022428c" 00:19:02.463 } 00:19:02.463 ] 00:19:02.463 } 00:19:02.463 ] 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@43 -- # wait 1005338 00:19:02.463 Asynchronous Event Request test 00:19:02.463 Attaching to 192.168.100.8 00:19:02.463 Attached to 192.168.100.8 00:19:02.463 Registering asynchronous event callbacks... 00:19:02.463 Starting namespace attribute notice tests for all controllers... 00:19:02.463 192.168.100.8: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:19:02.463 aer_cb - Changed Namespace 00:19:02.463 Cleaning up... 00:19:02.463 18:07:11 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:19:02.463 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.463 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:19:02.463 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.463 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:02.463 18:07:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:02.463 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.463 18:07:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:02.463 18:07:11 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:19:02.463 18:07:11 -- host/aer.sh@51 -- # nvmftestfini 00:19:02.463 18:07:11 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:02.463 18:07:11 -- nvmf/common.sh@117 -- # sync 00:19:02.463 18:07:11 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:02.463 18:07:11 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:02.463 18:07:11 -- nvmf/common.sh@120 -- # set +e 00:19:02.463 18:07:11 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:02.463 18:07:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:02.463 rmmod nvme_rdma 00:19:02.463 rmmod nvme_fabrics 00:19:02.463 18:07:11 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:02.463 18:07:11 -- nvmf/common.sh@124 -- # set -e 00:19:02.463 18:07:11 -- nvmf/common.sh@125 -- # return 0 00:19:02.463 18:07:11 -- nvmf/common.sh@478 -- # '[' -n 1005130 ']' 00:19:02.463 18:07:11 -- nvmf/common.sh@479 -- # killprocess 1005130 00:19:02.463 18:07:11 -- common/autotest_common.sh@946 -- # '[' -z 1005130 ']' 00:19:02.463 18:07:11 -- common/autotest_common.sh@950 -- # kill -0 1005130 00:19:02.463 18:07:11 -- common/autotest_common.sh@951 -- # uname 00:19:02.463 18:07:11 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:02.463 18:07:11 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1005130 00:19:02.722 18:07:11 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:19:02.722 18:07:11 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:19:02.722 18:07:11 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1005130' 00:19:02.722 killing process with pid 1005130 00:19:02.722 18:07:11 -- common/autotest_common.sh@965 -- # kill 1005130 00:19:02.722 [2024-04-26 18:07:11.663449] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:19:02.722 18:07:11 -- common/autotest_common.sh@970 -- # wait 1005130 00:19:02.722 [2024-04-26 18:07:11.751241] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:02.980 18:07:11 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:02.980 18:07:11 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:02.980 00:19:02.980 real 0m8.634s 00:19:02.980 user 0m8.755s 00:19:02.980 sys 0m5.542s 00:19:02.980 18:07:11 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:02.980 18:07:11 -- common/autotest_common.sh@10 -- # set +x 00:19:02.980 ************************************ 00:19:02.980 END TEST nvmf_aer 00:19:02.980 ************************************ 00:19:02.980 18:07:12 -- nvmf/nvmf.sh@91 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:19:02.980 18:07:12 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:19:02.980 18:07:12 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:19:02.980 18:07:12 -- common/autotest_common.sh@10 -- # set +x 00:19:03.239 ************************************ 00:19:03.239 START TEST nvmf_async_init 00:19:03.239 ************************************ 00:19:03.239 18:07:12 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=rdma 00:19:03.239 * Looking for test storage... 00:19:03.239 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:03.239 18:07:12 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:03.239 18:07:12 -- nvmf/common.sh@7 -- # uname -s 00:19:03.239 18:07:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:03.239 18:07:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:03.239 18:07:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:03.239 18:07:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:03.239 18:07:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:03.239 18:07:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:03.239 18:07:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:03.239 18:07:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:03.239 18:07:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:03.239 18:07:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:03.239 18:07:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:03.239 18:07:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:03.239 18:07:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:03.239 18:07:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:03.239 18:07:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:03.239 18:07:12 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:03.239 18:07:12 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:03.239 18:07:12 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:03.239 18:07:12 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:03.239 18:07:12 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:03.239 18:07:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.239 18:07:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.240 18:07:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.240 18:07:12 -- paths/export.sh@5 -- # export PATH 00:19:03.240 18:07:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.240 18:07:12 -- nvmf/common.sh@47 -- # : 0 00:19:03.240 18:07:12 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:03.240 18:07:12 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:03.240 18:07:12 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:03.240 18:07:12 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:03.240 18:07:12 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:03.240 18:07:12 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:03.240 18:07:12 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:03.240 18:07:12 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:03.240 18:07:12 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:19:03.240 18:07:12 -- host/async_init.sh@14 -- # null_block_size=512 00:19:03.240 18:07:12 -- host/async_init.sh@15 -- # null_bdev=null0 00:19:03.240 18:07:12 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:19:03.240 18:07:12 -- host/async_init.sh@20 -- # uuidgen 00:19:03.240 18:07:12 -- host/async_init.sh@20 -- # tr -d - 00:19:03.240 18:07:12 -- host/async_init.sh@20 -- # nguid=8ccc1841e19048b8bbcfffd1b78b9ee5 00:19:03.240 18:07:12 -- host/async_init.sh@22 -- # nvmftestinit 00:19:03.240 18:07:12 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:03.240 18:07:12 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:03.240 18:07:12 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:03.240 18:07:12 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:03.240 18:07:12 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:03.240 18:07:12 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.240 18:07:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.240 18:07:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.240 18:07:12 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:03.240 18:07:12 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:03.240 18:07:12 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:03.240 18:07:12 -- common/autotest_common.sh@10 -- # set +x 00:19:09.803 18:07:17 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:09.804 18:07:17 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:09.804 18:07:17 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:09.804 18:07:17 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:09.804 18:07:17 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:09.804 18:07:17 -- nvmf/common.sh@295 -- # net_devs=() 00:19:09.804 18:07:17 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@296 -- # e810=() 00:19:09.804 18:07:17 -- nvmf/common.sh@296 -- # local -ga e810 00:19:09.804 18:07:17 -- nvmf/common.sh@297 -- # x722=() 00:19:09.804 18:07:17 -- nvmf/common.sh@297 -- # local -ga x722 00:19:09.804 18:07:17 -- nvmf/common.sh@298 -- # mlx=() 00:19:09.804 18:07:17 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:09.804 18:07:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:09.804 18:07:17 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:09.804 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:09.804 18:07:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:09.804 18:07:17 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:09.804 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:09.804 18:07:17 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:09.804 18:07:17 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:09.804 18:07:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:09.804 18:07:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:09.804 Found net devices under 0000:18:00.0: mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:09.804 18:07:17 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:09.804 18:07:17 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:09.804 Found net devices under 0000:18:00.1: mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:09.804 18:07:17 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:09.804 18:07:17 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:09.804 18:07:17 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:09.804 18:07:17 -- nvmf/common.sh@58 -- # uname 00:19:09.804 18:07:17 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:09.804 18:07:17 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:09.804 18:07:17 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:09.804 18:07:17 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:09.804 18:07:17 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:09.804 18:07:17 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:09.804 18:07:17 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:09.804 18:07:17 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:09.804 18:07:17 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:09.804 18:07:17 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:09.804 18:07:17 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:09.804 18:07:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:09.804 18:07:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:09.804 18:07:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@105 -- # continue 2 00:19:09.804 18:07:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@105 -- # continue 2 00:19:09.804 18:07:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:09.804 18:07:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:09.804 18:07:17 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:09.804 18:07:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:09.804 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:09.804 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:09.804 altname enp24s0f0np0 00:19:09.804 altname ens785f0np0 00:19:09.804 inet 192.168.100.8/24 scope global mlx_0_0 00:19:09.804 valid_lft forever preferred_lft forever 00:19:09.804 18:07:17 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:09.804 18:07:17 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:09.804 18:07:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:09.804 18:07:17 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:09.804 18:07:17 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:09.804 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:09.804 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:09.804 altname enp24s0f1np1 00:19:09.804 altname ens785f1np1 00:19:09.804 inet 192.168.100.9/24 scope global mlx_0_1 00:19:09.804 valid_lft forever preferred_lft forever 00:19:09.804 18:07:17 -- nvmf/common.sh@411 -- # return 0 00:19:09.804 18:07:17 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:09.804 18:07:17 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:09.804 18:07:17 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:09.804 18:07:17 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:09.804 18:07:17 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:09.804 18:07:17 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:09.804 18:07:17 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:09.804 18:07:17 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:09.804 18:07:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:09.804 18:07:17 -- nvmf/common.sh@105 -- # continue 2 00:19:09.804 18:07:17 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:09.804 18:07:17 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:09.804 18:07:17 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:09.804 18:07:17 -- nvmf/common.sh@105 -- # continue 2 00:19:09.804 18:07:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:09.805 18:07:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:09.805 18:07:17 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:09.805 18:07:17 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:09.805 18:07:17 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:09.805 18:07:17 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:09.805 18:07:17 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:09.805 18:07:18 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:09.805 192.168.100.9' 00:19:09.805 18:07:18 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:09.805 192.168.100.9' 00:19:09.805 18:07:18 -- nvmf/common.sh@446 -- # head -n 1 00:19:09.805 18:07:18 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:09.805 18:07:18 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:09.805 192.168.100.9' 00:19:09.805 18:07:18 -- nvmf/common.sh@447 -- # head -n 1 00:19:09.805 18:07:18 -- nvmf/common.sh@447 -- # tail -n +2 00:19:09.805 18:07:18 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:09.805 18:07:18 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:09.805 18:07:18 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:09.805 18:07:18 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:09.805 18:07:18 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:09.805 18:07:18 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:09.805 18:07:18 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:19:09.805 18:07:18 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:09.805 18:07:18 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:09.805 18:07:18 -- common/autotest_common.sh@10 -- # set +x 00:19:09.805 18:07:18 -- nvmf/common.sh@470 -- # nvmfpid=1008237 00:19:09.805 18:07:18 -- nvmf/common.sh@471 -- # waitforlisten 1008237 00:19:09.805 18:07:18 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:19:09.805 18:07:18 -- common/autotest_common.sh@827 -- # '[' -z 1008237 ']' 00:19:09.805 18:07:18 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:09.805 18:07:18 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:09.805 18:07:18 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:09.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:09.805 18:07:18 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:09.805 18:07:18 -- common/autotest_common.sh@10 -- # set +x 00:19:09.805 [2024-04-26 18:07:18.107795] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:09.805 [2024-04-26 18:07:18.107860] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:09.805 EAL: No free 2048 kB hugepages reported on node 1 00:19:09.805 [2024-04-26 18:07:18.180822] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:09.805 [2024-04-26 18:07:18.263573] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:09.805 [2024-04-26 18:07:18.263619] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:09.805 [2024-04-26 18:07:18.263628] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:09.805 [2024-04-26 18:07:18.263653] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:09.805 [2024-04-26 18:07:18.263660] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:09.805 [2024-04-26 18:07:18.263681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:09.805 18:07:18 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:09.805 18:07:18 -- common/autotest_common.sh@860 -- # return 0 00:19:09.805 18:07:18 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:09.805 18:07:18 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:09.805 18:07:18 -- common/autotest_common.sh@10 -- # set +x 00:19:09.805 18:07:18 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:09.805 18:07:18 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:19:09.805 18:07:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:09.805 18:07:18 -- common/autotest_common.sh@10 -- # set +x 00:19:09.805 [2024-04-26 18:07:18.986640] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1f073e0/0x1f0b8d0) succeed. 00:19:10.065 [2024-04-26 18:07:18.997017] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1f088e0/0x1f4cf60) succeed. 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 null0 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 8ccc1841e19048b8bbcfffd1b78b9ee5 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 [2024-04-26 18:07:19.088305] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 nvme0n1 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 [ 00:19:10.065 { 00:19:10.065 "name": "nvme0n1", 00:19:10.065 "aliases": [ 00:19:10.065 "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5" 00:19:10.065 ], 00:19:10.065 "product_name": "NVMe disk", 00:19:10.065 "block_size": 512, 00:19:10.065 "num_blocks": 2097152, 00:19:10.065 "uuid": "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5", 00:19:10.065 "assigned_rate_limits": { 00:19:10.065 "rw_ios_per_sec": 0, 00:19:10.065 "rw_mbytes_per_sec": 0, 00:19:10.065 "r_mbytes_per_sec": 0, 00:19:10.065 "w_mbytes_per_sec": 0 00:19:10.065 }, 00:19:10.065 "claimed": false, 00:19:10.065 "zoned": false, 00:19:10.065 "supported_io_types": { 00:19:10.065 "read": true, 00:19:10.065 "write": true, 00:19:10.065 "unmap": false, 00:19:10.065 "write_zeroes": true, 00:19:10.065 "flush": true, 00:19:10.065 "reset": true, 00:19:10.065 "compare": true, 00:19:10.065 "compare_and_write": true, 00:19:10.065 "abort": true, 00:19:10.065 "nvme_admin": true, 00:19:10.065 "nvme_io": true 00:19:10.065 }, 00:19:10.065 "memory_domains": [ 00:19:10.065 { 00:19:10.065 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:10.065 "dma_device_type": 0 00:19:10.065 } 00:19:10.065 ], 00:19:10.065 "driver_specific": { 00:19:10.065 "nvme": [ 00:19:10.065 { 00:19:10.065 "trid": { 00:19:10.065 "trtype": "RDMA", 00:19:10.065 "adrfam": "IPv4", 00:19:10.065 "traddr": "192.168.100.8", 00:19:10.065 "trsvcid": "4420", 00:19:10.065 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:10.065 }, 00:19:10.065 "ctrlr_data": { 00:19:10.065 "cntlid": 1, 00:19:10.065 "vendor_id": "0x8086", 00:19:10.065 "model_number": "SPDK bdev Controller", 00:19:10.065 "serial_number": "00000000000000000000", 00:19:10.065 "firmware_revision": "24.05", 00:19:10.065 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:10.065 "oacs": { 00:19:10.065 "security": 0, 00:19:10.065 "format": 0, 00:19:10.065 "firmware": 0, 00:19:10.065 "ns_manage": 0 00:19:10.065 }, 00:19:10.065 "multi_ctrlr": true, 00:19:10.065 "ana_reporting": false 00:19:10.065 }, 00:19:10.065 "vs": { 00:19:10.065 "nvme_version": "1.3" 00:19:10.065 }, 00:19:10.065 "ns_data": { 00:19:10.065 "id": 1, 00:19:10.065 "can_share": true 00:19:10.065 } 00:19:10.065 } 00:19:10.065 ], 00:19:10.065 "mp_policy": "active_passive" 00:19:10.065 } 00:19:10.065 } 00:19:10.065 ] 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 [2024-04-26 18:07:19.187042] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:19:10.065 [2024-04-26 18:07:19.211349] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:19:10.065 [2024-04-26 18:07:19.235134] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.065 [ 00:19:10.065 { 00:19:10.065 "name": "nvme0n1", 00:19:10.065 "aliases": [ 00:19:10.065 "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5" 00:19:10.065 ], 00:19:10.065 "product_name": "NVMe disk", 00:19:10.065 "block_size": 512, 00:19:10.065 "num_blocks": 2097152, 00:19:10.065 "uuid": "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5", 00:19:10.065 "assigned_rate_limits": { 00:19:10.065 "rw_ios_per_sec": 0, 00:19:10.065 "rw_mbytes_per_sec": 0, 00:19:10.065 "r_mbytes_per_sec": 0, 00:19:10.065 "w_mbytes_per_sec": 0 00:19:10.065 }, 00:19:10.065 "claimed": false, 00:19:10.065 "zoned": false, 00:19:10.065 "supported_io_types": { 00:19:10.065 "read": true, 00:19:10.065 "write": true, 00:19:10.065 "unmap": false, 00:19:10.065 "write_zeroes": true, 00:19:10.065 "flush": true, 00:19:10.065 "reset": true, 00:19:10.065 "compare": true, 00:19:10.065 "compare_and_write": true, 00:19:10.065 "abort": true, 00:19:10.065 "nvme_admin": true, 00:19:10.065 "nvme_io": true 00:19:10.065 }, 00:19:10.065 "memory_domains": [ 00:19:10.065 { 00:19:10.065 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:10.065 "dma_device_type": 0 00:19:10.065 } 00:19:10.065 ], 00:19:10.065 "driver_specific": { 00:19:10.065 "nvme": [ 00:19:10.065 { 00:19:10.065 "trid": { 00:19:10.065 "trtype": "RDMA", 00:19:10.065 "adrfam": "IPv4", 00:19:10.065 "traddr": "192.168.100.8", 00:19:10.065 "trsvcid": "4420", 00:19:10.065 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:10.065 }, 00:19:10.065 "ctrlr_data": { 00:19:10.065 "cntlid": 2, 00:19:10.065 "vendor_id": "0x8086", 00:19:10.065 "model_number": "SPDK bdev Controller", 00:19:10.065 "serial_number": "00000000000000000000", 00:19:10.065 "firmware_revision": "24.05", 00:19:10.065 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:10.065 "oacs": { 00:19:10.065 "security": 0, 00:19:10.065 "format": 0, 00:19:10.065 "firmware": 0, 00:19:10.065 "ns_manage": 0 00:19:10.065 }, 00:19:10.065 "multi_ctrlr": true, 00:19:10.065 "ana_reporting": false 00:19:10.065 }, 00:19:10.065 "vs": { 00:19:10.065 "nvme_version": "1.3" 00:19:10.065 }, 00:19:10.065 "ns_data": { 00:19:10.065 "id": 1, 00:19:10.065 "can_share": true 00:19:10.065 } 00:19:10.065 } 00:19:10.065 ], 00:19:10.065 "mp_policy": "active_passive" 00:19:10.065 } 00:19:10.065 } 00:19:10.065 ] 00:19:10.065 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.065 18:07:19 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:10.065 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.065 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.325 18:07:19 -- host/async_init.sh@53 -- # mktemp 00:19:10.325 18:07:19 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.3DM5yCHVmC 00:19:10.325 18:07:19 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:10.325 18:07:19 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.3DM5yCHVmC 00:19:10.325 18:07:19 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.325 18:07:19 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4421 --secure-channel 00:19:10.325 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 [2024-04-26 18:07:19.298547] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:19:10.325 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.325 18:07:19 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.3DM5yCHVmC 00:19:10.325 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.325 18:07:19 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -a 192.168.100.8 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.3DM5yCHVmC 00:19:10.325 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 [2024-04-26 18:07:19.314569] bdev_nvme_rpc.c: 515:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:10.325 nvme0n1 00:19:10.325 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.325 18:07:19 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:19:10.325 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.325 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.325 [ 00:19:10.325 { 00:19:10.325 "name": "nvme0n1", 00:19:10.325 "aliases": [ 00:19:10.325 "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5" 00:19:10.325 ], 00:19:10.325 "product_name": "NVMe disk", 00:19:10.325 "block_size": 512, 00:19:10.325 "num_blocks": 2097152, 00:19:10.325 "uuid": "8ccc1841-e190-48b8-bbcf-ffd1b78b9ee5", 00:19:10.325 "assigned_rate_limits": { 00:19:10.325 "rw_ios_per_sec": 0, 00:19:10.325 "rw_mbytes_per_sec": 0, 00:19:10.325 "r_mbytes_per_sec": 0, 00:19:10.325 "w_mbytes_per_sec": 0 00:19:10.325 }, 00:19:10.325 "claimed": false, 00:19:10.325 "zoned": false, 00:19:10.325 "supported_io_types": { 00:19:10.325 "read": true, 00:19:10.325 "write": true, 00:19:10.325 "unmap": false, 00:19:10.325 "write_zeroes": true, 00:19:10.325 "flush": true, 00:19:10.325 "reset": true, 00:19:10.325 "compare": true, 00:19:10.325 "compare_and_write": true, 00:19:10.325 "abort": true, 00:19:10.325 "nvme_admin": true, 00:19:10.325 "nvme_io": true 00:19:10.325 }, 00:19:10.325 "memory_domains": [ 00:19:10.325 { 00:19:10.325 "dma_device_id": "SPDK_RDMA_DMA_DEVICE", 00:19:10.325 "dma_device_type": 0 00:19:10.325 } 00:19:10.325 ], 00:19:10.325 "driver_specific": { 00:19:10.325 "nvme": [ 00:19:10.325 { 00:19:10.325 "trid": { 00:19:10.325 "trtype": "RDMA", 00:19:10.325 "adrfam": "IPv4", 00:19:10.325 "traddr": "192.168.100.8", 00:19:10.325 "trsvcid": "4421", 00:19:10.325 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:19:10.325 }, 00:19:10.325 "ctrlr_data": { 00:19:10.325 "cntlid": 3, 00:19:10.325 "vendor_id": "0x8086", 00:19:10.325 "model_number": "SPDK bdev Controller", 00:19:10.325 "serial_number": "00000000000000000000", 00:19:10.325 "firmware_revision": "24.05", 00:19:10.325 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:10.325 "oacs": { 00:19:10.325 "security": 0, 00:19:10.325 "format": 0, 00:19:10.325 "firmware": 0, 00:19:10.325 "ns_manage": 0 00:19:10.325 }, 00:19:10.325 "multi_ctrlr": true, 00:19:10.325 "ana_reporting": false 00:19:10.325 }, 00:19:10.325 "vs": { 00:19:10.325 "nvme_version": "1.3" 00:19:10.325 }, 00:19:10.325 "ns_data": { 00:19:10.325 "id": 1, 00:19:10.325 "can_share": true 00:19:10.325 } 00:19:10.325 } 00:19:10.325 ], 00:19:10.326 "mp_policy": "active_passive" 00:19:10.326 } 00:19:10.326 } 00:19:10.326 ] 00:19:10.326 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.326 18:07:19 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:19:10.326 18:07:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:10.326 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.326 18:07:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:10.326 18:07:19 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.3DM5yCHVmC 00:19:10.326 18:07:19 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:19:10.326 18:07:19 -- host/async_init.sh@78 -- # nvmftestfini 00:19:10.326 18:07:19 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:10.326 18:07:19 -- nvmf/common.sh@117 -- # sync 00:19:10.326 18:07:19 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:10.326 18:07:19 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:10.326 18:07:19 -- nvmf/common.sh@120 -- # set +e 00:19:10.326 18:07:19 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:10.326 18:07:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:10.326 rmmod nvme_rdma 00:19:10.326 rmmod nvme_fabrics 00:19:10.326 18:07:19 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:10.326 18:07:19 -- nvmf/common.sh@124 -- # set -e 00:19:10.326 18:07:19 -- nvmf/common.sh@125 -- # return 0 00:19:10.326 18:07:19 -- nvmf/common.sh@478 -- # '[' -n 1008237 ']' 00:19:10.326 18:07:19 -- nvmf/common.sh@479 -- # killprocess 1008237 00:19:10.326 18:07:19 -- common/autotest_common.sh@946 -- # '[' -z 1008237 ']' 00:19:10.326 18:07:19 -- common/autotest_common.sh@950 -- # kill -0 1008237 00:19:10.326 18:07:19 -- common/autotest_common.sh@951 -- # uname 00:19:10.326 18:07:19 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:10.326 18:07:19 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1008237 00:19:10.663 18:07:19 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:19:10.663 18:07:19 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:19:10.663 18:07:19 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1008237' 00:19:10.663 killing process with pid 1008237 00:19:10.663 18:07:19 -- common/autotest_common.sh@965 -- # kill 1008237 00:19:10.663 18:07:19 -- common/autotest_common.sh@970 -- # wait 1008237 00:19:10.663 [2024-04-26 18:07:19.576809] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:10.663 18:07:19 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:10.663 18:07:19 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:10.663 00:19:10.663 real 0m7.632s 00:19:10.663 user 0m3.580s 00:19:10.663 sys 0m4.728s 00:19:10.663 18:07:19 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:10.663 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.663 ************************************ 00:19:10.663 END TEST nvmf_async_init 00:19:10.663 ************************************ 00:19:10.922 18:07:19 -- nvmf/nvmf.sh@92 -- # run_test dma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:19:10.922 18:07:19 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:19:10.922 18:07:19 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:19:10.922 18:07:19 -- common/autotest_common.sh@10 -- # set +x 00:19:10.922 ************************************ 00:19:10.922 START TEST dma 00:19:10.922 ************************************ 00:19:10.922 18:07:20 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=rdma 00:19:10.922 * Looking for test storage... 00:19:10.922 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:11.181 18:07:20 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:11.181 18:07:20 -- nvmf/common.sh@7 -- # uname -s 00:19:11.181 18:07:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:11.181 18:07:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:11.181 18:07:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:11.181 18:07:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:11.181 18:07:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:11.181 18:07:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:11.181 18:07:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:11.181 18:07:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:11.181 18:07:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:11.181 18:07:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:11.181 18:07:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:11.181 18:07:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:11.181 18:07:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:11.181 18:07:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:11.181 18:07:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:11.181 18:07:20 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:11.181 18:07:20 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:11.181 18:07:20 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:11.181 18:07:20 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:11.181 18:07:20 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:11.182 18:07:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.182 18:07:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.182 18:07:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.182 18:07:20 -- paths/export.sh@5 -- # export PATH 00:19:11.182 18:07:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:11.182 18:07:20 -- nvmf/common.sh@47 -- # : 0 00:19:11.182 18:07:20 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:11.182 18:07:20 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:11.182 18:07:20 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:11.182 18:07:20 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:11.182 18:07:20 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:11.182 18:07:20 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:11.182 18:07:20 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:11.182 18:07:20 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:11.182 18:07:20 -- host/dma.sh@12 -- # '[' rdma '!=' rdma ']' 00:19:11.182 18:07:20 -- host/dma.sh@16 -- # MALLOC_BDEV_SIZE=256 00:19:11.182 18:07:20 -- host/dma.sh@17 -- # MALLOC_BLOCK_SIZE=512 00:19:11.182 18:07:20 -- host/dma.sh@18 -- # subsystem=0 00:19:11.182 18:07:20 -- host/dma.sh@93 -- # nvmftestinit 00:19:11.182 18:07:20 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:11.182 18:07:20 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:11.182 18:07:20 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:11.182 18:07:20 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:11.182 18:07:20 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:11.182 18:07:20 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:11.182 18:07:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:11.182 18:07:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:11.182 18:07:20 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:11.182 18:07:20 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:11.182 18:07:20 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:11.182 18:07:20 -- common/autotest_common.sh@10 -- # set +x 00:19:17.746 18:07:25 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:17.746 18:07:25 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:17.746 18:07:25 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:17.746 18:07:25 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:17.746 18:07:25 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:17.746 18:07:25 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:17.746 18:07:25 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:17.746 18:07:25 -- nvmf/common.sh@295 -- # net_devs=() 00:19:17.746 18:07:25 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:17.746 18:07:25 -- nvmf/common.sh@296 -- # e810=() 00:19:17.746 18:07:25 -- nvmf/common.sh@296 -- # local -ga e810 00:19:17.746 18:07:25 -- nvmf/common.sh@297 -- # x722=() 00:19:17.746 18:07:25 -- nvmf/common.sh@297 -- # local -ga x722 00:19:17.746 18:07:25 -- nvmf/common.sh@298 -- # mlx=() 00:19:17.746 18:07:25 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:17.746 18:07:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:17.746 18:07:25 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:17.746 18:07:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:17.746 18:07:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:17.746 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:17.746 18:07:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:17.746 18:07:25 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:17.746 18:07:25 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:17.746 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:17.746 18:07:25 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:17.746 18:07:25 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:17.746 18:07:25 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:17.746 18:07:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.746 18:07:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:17.746 18:07:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.746 18:07:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:17.746 Found net devices under 0000:18:00.0: mlx_0_0 00:19:17.746 18:07:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:17.746 18:07:25 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:17.746 18:07:25 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:17.746 18:07:25 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:17.746 18:07:25 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:17.746 Found net devices under 0000:18:00.1: mlx_0_1 00:19:17.746 18:07:25 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:17.746 18:07:25 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:17.746 18:07:25 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:17.746 18:07:25 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:17.746 18:07:25 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:17.746 18:07:25 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:17.746 18:07:25 -- nvmf/common.sh@58 -- # uname 00:19:17.746 18:07:25 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:17.746 18:07:25 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:17.746 18:07:25 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:17.746 18:07:25 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:17.746 18:07:25 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:17.746 18:07:25 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:17.746 18:07:25 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:17.746 18:07:25 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:17.746 18:07:25 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:17.746 18:07:25 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:17.746 18:07:25 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:17.747 18:07:25 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:17.747 18:07:25 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:17.747 18:07:25 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:17.747 18:07:25 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:17.747 18:07:25 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:17.747 18:07:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:17.747 18:07:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:25 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:17.747 18:07:25 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:17.747 18:07:25 -- nvmf/common.sh@105 -- # continue 2 00:19:17.747 18:07:25 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:17.747 18:07:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:17.747 18:07:25 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:25 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:17.747 18:07:25 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:17.747 18:07:25 -- nvmf/common.sh@105 -- # continue 2 00:19:17.747 18:07:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:17.747 18:07:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:17.747 18:07:25 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:17.747 18:07:25 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:17.747 18:07:25 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:17.747 18:07:25 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:17.747 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:17.747 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:17.747 altname enp24s0f0np0 00:19:17.747 altname ens785f0np0 00:19:17.747 inet 192.168.100.8/24 scope global mlx_0_0 00:19:17.747 valid_lft forever preferred_lft forever 00:19:17.747 18:07:25 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:17.747 18:07:25 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:17.747 18:07:25 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:17.747 18:07:25 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:17.747 18:07:26 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:17.747 18:07:26 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:17.747 18:07:26 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:17.747 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:17.747 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:17.747 altname enp24s0f1np1 00:19:17.747 altname ens785f1np1 00:19:17.747 inet 192.168.100.9/24 scope global mlx_0_1 00:19:17.747 valid_lft forever preferred_lft forever 00:19:17.747 18:07:26 -- nvmf/common.sh@411 -- # return 0 00:19:17.747 18:07:26 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:17.747 18:07:26 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:17.747 18:07:26 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:17.747 18:07:26 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:17.747 18:07:26 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:17.747 18:07:26 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:17.747 18:07:26 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:17.747 18:07:26 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:17.747 18:07:26 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:17.747 18:07:26 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:17.747 18:07:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:17.747 18:07:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:26 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:17.747 18:07:26 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:17.747 18:07:26 -- nvmf/common.sh@105 -- # continue 2 00:19:17.747 18:07:26 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:17.747 18:07:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:17.747 18:07:26 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:17.747 18:07:26 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:17.747 18:07:26 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:17.747 18:07:26 -- nvmf/common.sh@105 -- # continue 2 00:19:17.747 18:07:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:17.747 18:07:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:17.747 18:07:26 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:17.747 18:07:26 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:17.747 18:07:26 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:17.747 18:07:26 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:17.747 18:07:26 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:17.747 18:07:26 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:17.747 192.168.100.9' 00:19:17.747 18:07:26 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:17.747 192.168.100.9' 00:19:17.747 18:07:26 -- nvmf/common.sh@446 -- # head -n 1 00:19:17.747 18:07:26 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:17.747 18:07:26 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:17.747 192.168.100.9' 00:19:17.747 18:07:26 -- nvmf/common.sh@447 -- # head -n 1 00:19:17.747 18:07:26 -- nvmf/common.sh@447 -- # tail -n +2 00:19:17.747 18:07:26 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:17.747 18:07:26 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:17.747 18:07:26 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:17.747 18:07:26 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:17.747 18:07:26 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:17.747 18:07:26 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:17.747 18:07:26 -- host/dma.sh@94 -- # nvmfappstart -m 0x3 00:19:17.747 18:07:26 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:17.747 18:07:26 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:17.747 18:07:26 -- common/autotest_common.sh@10 -- # set +x 00:19:17.747 18:07:26 -- nvmf/common.sh@470 -- # nvmfpid=1011343 00:19:17.747 18:07:26 -- nvmf/common.sh@471 -- # waitforlisten 1011343 00:19:17.747 18:07:26 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:19:17.747 18:07:26 -- common/autotest_common.sh@827 -- # '[' -z 1011343 ']' 00:19:17.747 18:07:26 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:17.747 18:07:26 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:17.747 18:07:26 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:17.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:17.747 18:07:26 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:17.747 18:07:26 -- common/autotest_common.sh@10 -- # set +x 00:19:17.747 [2024-04-26 18:07:26.181570] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:17.747 [2024-04-26 18:07:26.181631] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:17.747 EAL: No free 2048 kB hugepages reported on node 1 00:19:17.747 [2024-04-26 18:07:26.253610] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:17.747 [2024-04-26 18:07:26.339948] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:17.747 [2024-04-26 18:07:26.339988] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:17.747 [2024-04-26 18:07:26.339999] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:17.747 [2024-04-26 18:07:26.340008] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:17.747 [2024-04-26 18:07:26.340015] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:17.747 [2024-04-26 18:07:26.340063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:17.747 [2024-04-26 18:07:26.340066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:18.007 18:07:26 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:18.007 18:07:26 -- common/autotest_common.sh@860 -- # return 0 00:19:18.007 18:07:26 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:18.007 18:07:26 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:18.007 18:07:26 -- common/autotest_common.sh@10 -- # set +x 00:19:18.007 18:07:27 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:18.007 18:07:27 -- host/dma.sh@96 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:19:18.007 18:07:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:18.007 18:07:27 -- common/autotest_common.sh@10 -- # set +x 00:19:18.007 [2024-04-26 18:07:27.052929] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x16fbf40/0x1700430) succeed. 00:19:18.007 [2024-04-26 18:07:27.062096] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x16fd440/0x1741ac0) succeed. 00:19:18.007 18:07:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:18.007 18:07:27 -- host/dma.sh@97 -- # rpc_cmd bdev_malloc_create 256 512 -b Malloc0 00:19:18.007 18:07:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:18.007 18:07:27 -- common/autotest_common.sh@10 -- # set +x 00:19:18.266 Malloc0 00:19:18.266 18:07:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:18.266 18:07:27 -- host/dma.sh@98 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK00000000000001 00:19:18.266 18:07:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:18.266 18:07:27 -- common/autotest_common.sh@10 -- # set +x 00:19:18.266 18:07:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:18.266 18:07:27 -- host/dma.sh@99 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Malloc0 00:19:18.266 18:07:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:18.266 18:07:27 -- common/autotest_common.sh@10 -- # set +x 00:19:18.266 18:07:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:18.266 18:07:27 -- host/dma.sh@100 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t rdma -a 192.168.100.8 -s 4420 00:19:18.266 18:07:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:18.266 18:07:27 -- common/autotest_common.sh@10 -- # set +x 00:19:18.266 [2024-04-26 18:07:27.231772] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:18.266 18:07:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:18.266 18:07:27 -- host/dma.sh@104 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Nvme0n1 -f -x translate 00:19:18.266 18:07:27 -- host/dma.sh@104 -- # gen_nvmf_target_json 0 00:19:18.266 18:07:27 -- nvmf/common.sh@521 -- # config=() 00:19:18.266 18:07:27 -- nvmf/common.sh@521 -- # local subsystem config 00:19:18.266 18:07:27 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:19:18.266 18:07:27 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:19:18.266 { 00:19:18.266 "params": { 00:19:18.266 "name": "Nvme$subsystem", 00:19:18.266 "trtype": "$TEST_TRANSPORT", 00:19:18.266 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:18.266 "adrfam": "ipv4", 00:19:18.266 "trsvcid": "$NVMF_PORT", 00:19:18.266 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:18.266 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:18.266 "hdgst": ${hdgst:-false}, 00:19:18.266 "ddgst": ${ddgst:-false} 00:19:18.266 }, 00:19:18.266 "method": "bdev_nvme_attach_controller" 00:19:18.266 } 00:19:18.266 EOF 00:19:18.266 )") 00:19:18.266 18:07:27 -- nvmf/common.sh@543 -- # cat 00:19:18.266 18:07:27 -- nvmf/common.sh@545 -- # jq . 00:19:18.266 18:07:27 -- nvmf/common.sh@546 -- # IFS=, 00:19:18.266 18:07:27 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:19:18.266 "params": { 00:19:18.266 "name": "Nvme0", 00:19:18.266 "trtype": "rdma", 00:19:18.266 "traddr": "192.168.100.8", 00:19:18.266 "adrfam": "ipv4", 00:19:18.267 "trsvcid": "4420", 00:19:18.267 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:19:18.267 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:19:18.267 "hdgst": false, 00:19:18.267 "ddgst": false 00:19:18.267 }, 00:19:18.267 "method": "bdev_nvme_attach_controller" 00:19:18.267 }' 00:19:18.267 [2024-04-26 18:07:27.284202] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:18.267 [2024-04-26 18:07:27.284268] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1011493 ] 00:19:18.267 EAL: No free 2048 kB hugepages reported on node 1 00:19:18.267 [2024-04-26 18:07:27.356476] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:18.267 [2024-04-26 18:07:27.447357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:18.267 [2024-04-26 18:07:27.447360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:24.847 bdev Nvme0n1 reports 1 memory domains 00:19:24.847 bdev Nvme0n1 supports RDMA memory domain 00:19:24.847 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:24.847 ========================================================================== 00:19:24.847 Latency [us] 00:19:24.847 IOPS MiB/s Average min max 00:19:24.847 Core 2: 21531.93 84.11 742.39 250.03 9049.48 00:19:24.847 Core 3: 21877.29 85.46 730.62 238.92 8980.04 00:19:24.847 ========================================================================== 00:19:24.847 Total : 43409.22 169.57 736.46 238.92 9049.48 00:19:24.847 00:19:24.847 Total operations: 217069, translate 217069 pull_push 0 memzero 0 00:19:24.847 18:07:32 -- host/dma.sh@107 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b Malloc0 -x pull_push 00:19:24.847 18:07:32 -- host/dma.sh@107 -- # gen_malloc_json 00:19:24.847 18:07:32 -- host/dma.sh@21 -- # jq . 00:19:24.847 [2024-04-26 18:07:32.931221] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:24.847 [2024-04-26 18:07:32.931282] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1012263 ] 00:19:24.847 EAL: No free 2048 kB hugepages reported on node 1 00:19:24.847 [2024-04-26 18:07:32.997769] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:24.847 [2024-04-26 18:07:33.076495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:24.847 [2024-04-26 18:07:33.076499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:30.123 bdev Malloc0 reports 2 memory domains 00:19:30.123 bdev Malloc0 doesn't support RDMA memory domain 00:19:30.123 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:30.123 ========================================================================== 00:19:30.123 Latency [us] 00:19:30.123 IOPS MiB/s Average min max 00:19:30.123 Core 2: 14624.11 57.13 1093.33 475.16 1431.87 00:19:30.123 Core 3: 14629.71 57.15 1092.91 456.51 2048.99 00:19:30.123 ========================================================================== 00:19:30.123 Total : 29253.82 114.27 1093.12 456.51 2048.99 00:19:30.123 00:19:30.123 Total operations: 146320, translate 0 pull_push 585280 memzero 0 00:19:30.123 18:07:38 -- host/dma.sh@110 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randread -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x memzero 00:19:30.123 18:07:38 -- host/dma.sh@110 -- # gen_lvol_nvme_json 0 00:19:30.123 18:07:38 -- host/dma.sh@48 -- # local subsystem=0 00:19:30.123 18:07:38 -- host/dma.sh@50 -- # jq . 00:19:30.123 Ignoring -M option 00:19:30.123 [2024-04-26 18:07:38.498773] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:30.123 [2024-04-26 18:07:38.498845] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1012972 ] 00:19:30.123 EAL: No free 2048 kB hugepages reported on node 1 00:19:30.123 [2024-04-26 18:07:38.568521] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:30.123 [2024-04-26 18:07:38.647121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:30.123 [2024-04-26 18:07:38.647124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:30.123 [2024-04-26 18:07:38.869803] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:19:35.392 [2024-04-26 18:07:43.897789] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:19:35.392 bdev 528e2659-7623-40c1-a070-487de680a03a reports 1 memory domains 00:19:35.392 bdev 528e2659-7623-40c1-a070-487de680a03a supports RDMA memory domain 00:19:35.392 Initialization complete, running randread IO for 5 sec on 2 cores 00:19:35.392 ========================================================================== 00:19:35.393 Latency [us] 00:19:35.393 IOPS MiB/s Average min max 00:19:35.393 Core 2: 82899.77 323.83 192.30 73.05 3104.48 00:19:35.393 Core 3: 85479.94 333.91 186.51 71.34 3004.55 00:19:35.393 ========================================================================== 00:19:35.393 Total : 168379.71 657.73 189.36 71.34 3104.48 00:19:35.393 00:19:35.393 Total operations: 841974, translate 0 pull_push 0 memzero 841974 00:19:35.393 18:07:44 -- host/dma.sh@113 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 16 -o 4096 -w write -t 1 -r 'trtype:rdma adrfam:IPV4 traddr:192.168.100.8 trsvcid:4420' 00:19:35.393 EAL: No free 2048 kB hugepages reported on node 1 00:19:35.393 [2024-04-26 18:07:44.267557] subsystem.c:1435:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on RDMA/192.168.100.8/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:19:37.926 Initializing NVMe Controllers 00:19:37.926 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode0 00:19:37.926 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:19:37.926 Initialization complete. Launching workers. 00:19:37.926 ======================================================== 00:19:37.926 Latency(us) 00:19:37.926 Device Information : IOPS MiB/s Average min max 00:19:37.926 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 0: 2008.87 7.85 7964.30 5986.29 8981.87 00:19:37.926 ======================================================== 00:19:37.926 Total : 2008.87 7.85 7964.30 5986.29 8981.87 00:19:37.926 00:19:37.926 18:07:46 -- host/dma.sh@116 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/dma/test_dma/test_dma -q 16 -o 4096 -w randrw -M 70 -t 5 -m 0xc --json /dev/fd/62 -b lvs0/lvol0 -f -x translate 00:19:37.926 18:07:46 -- host/dma.sh@116 -- # gen_lvol_nvme_json 0 00:19:37.926 18:07:46 -- host/dma.sh@48 -- # local subsystem=0 00:19:37.926 18:07:46 -- host/dma.sh@50 -- # jq . 00:19:37.926 [2024-04-26 18:07:46.602110] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:37.926 [2024-04-26 18:07:46.602176] [ DPDK EAL parameters: test_dma --no-shconf -c 0xc --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1013932 ] 00:19:37.926 EAL: No free 2048 kB hugepages reported on node 1 00:19:37.926 [2024-04-26 18:07:46.671995] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:19:37.926 [2024-04-26 18:07:46.752672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:37.926 [2024-04-26 18:07:46.752674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:37.926 [2024-04-26 18:07:46.984519] vbdev_lvol_rpc.c: 347:rpc_bdev_lvol_create: *WARNING*: vbdev_lvol_rpc_req_size: deprecated feature rpc_bdev_lvol_create/resize req.size to be removed in v23.09 00:19:43.195 [2024-04-26 18:07:52.014886] app.c: 937:log_deprecation_hits: *WARNING*: vbdev_lvol_rpc_req_size: deprecation 'rpc_bdev_lvol_create/resize req.size' scheduled for removal in v23.09 hit 1 times 00:19:43.195 bdev 0205dfa6-14ff-41a6-aeb0-5c1176190c85 reports 1 memory domains 00:19:43.195 bdev 0205dfa6-14ff-41a6-aeb0-5c1176190c85 supports RDMA memory domain 00:19:43.195 Initialization complete, running randrw IO for 5 sec on 2 cores 00:19:43.195 ========================================================================== 00:19:43.195 Latency [us] 00:19:43.195 IOPS MiB/s Average min max 00:19:43.195 Core 2: 19198.44 74.99 832.63 44.94 11756.24 00:19:43.195 Core 3: 19442.96 75.95 822.17 19.07 11902.15 00:19:43.195 ========================================================================== 00:19:43.195 Total : 38641.40 150.94 827.37 19.07 11902.15 00:19:43.195 00:19:43.195 Total operations: 193267, translate 193159 pull_push 0 memzero 108 00:19:43.195 18:07:52 -- host/dma.sh@118 -- # trap - SIGINT SIGTERM EXIT 00:19:43.195 18:07:52 -- host/dma.sh@120 -- # nvmftestfini 00:19:43.195 18:07:52 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:43.195 18:07:52 -- nvmf/common.sh@117 -- # sync 00:19:43.195 18:07:52 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:43.195 18:07:52 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:43.195 18:07:52 -- nvmf/common.sh@120 -- # set +e 00:19:43.195 18:07:52 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:43.195 18:07:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:43.195 rmmod nvme_rdma 00:19:43.195 rmmod nvme_fabrics 00:19:43.195 18:07:52 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:43.195 18:07:52 -- nvmf/common.sh@124 -- # set -e 00:19:43.195 18:07:52 -- nvmf/common.sh@125 -- # return 0 00:19:43.195 18:07:52 -- nvmf/common.sh@478 -- # '[' -n 1011343 ']' 00:19:43.195 18:07:52 -- nvmf/common.sh@479 -- # killprocess 1011343 00:19:43.195 18:07:52 -- common/autotest_common.sh@946 -- # '[' -z 1011343 ']' 00:19:43.195 18:07:52 -- common/autotest_common.sh@950 -- # kill -0 1011343 00:19:43.195 18:07:52 -- common/autotest_common.sh@951 -- # uname 00:19:43.195 18:07:52 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:43.195 18:07:52 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1011343 00:19:43.195 18:07:52 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:19:43.195 18:07:52 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:19:43.195 18:07:52 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1011343' 00:19:43.195 killing process with pid 1011343 00:19:43.195 18:07:52 -- common/autotest_common.sh@965 -- # kill 1011343 00:19:43.195 18:07:52 -- common/autotest_common.sh@970 -- # wait 1011343 00:19:43.453 [2024-04-26 18:07:52.440784] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:43.712 18:07:52 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:43.712 18:07:52 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:43.712 00:19:43.712 real 0m32.748s 00:19:43.712 user 1m37.553s 00:19:43.712 sys 0m5.907s 00:19:43.712 18:07:52 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:43.712 18:07:52 -- common/autotest_common.sh@10 -- # set +x 00:19:43.712 ************************************ 00:19:43.712 END TEST dma 00:19:43.712 ************************************ 00:19:43.712 18:07:52 -- nvmf/nvmf.sh@95 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:19:43.712 18:07:52 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:19:43.712 18:07:52 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:19:43.712 18:07:52 -- common/autotest_common.sh@10 -- # set +x 00:19:43.972 ************************************ 00:19:43.972 START TEST nvmf_identify 00:19:43.972 ************************************ 00:19:43.972 18:07:52 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=rdma 00:19:43.972 * Looking for test storage... 00:19:43.972 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:43.972 18:07:53 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:43.972 18:07:53 -- nvmf/common.sh@7 -- # uname -s 00:19:43.972 18:07:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:43.972 18:07:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:43.972 18:07:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:43.972 18:07:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:43.972 18:07:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:43.972 18:07:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:43.972 18:07:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:43.972 18:07:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:43.972 18:07:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:43.972 18:07:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:43.972 18:07:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:43.972 18:07:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:43.972 18:07:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:43.972 18:07:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:43.972 18:07:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:43.972 18:07:53 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:43.972 18:07:53 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:43.972 18:07:53 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:43.972 18:07:53 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:43.972 18:07:53 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:43.972 18:07:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.972 18:07:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.972 18:07:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.972 18:07:53 -- paths/export.sh@5 -- # export PATH 00:19:43.972 18:07:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:43.972 18:07:53 -- nvmf/common.sh@47 -- # : 0 00:19:43.972 18:07:53 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:43.972 18:07:53 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:43.972 18:07:53 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:43.972 18:07:53 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:43.972 18:07:53 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:43.972 18:07:53 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:43.972 18:07:53 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:43.972 18:07:53 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:43.972 18:07:53 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:43.972 18:07:53 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:43.972 18:07:53 -- host/identify.sh@14 -- # nvmftestinit 00:19:43.972 18:07:53 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:43.972 18:07:53 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:43.972 18:07:53 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:43.972 18:07:53 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:43.972 18:07:53 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:43.972 18:07:53 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:43.972 18:07:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:43.972 18:07:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:43.972 18:07:53 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:43.972 18:07:53 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:43.972 18:07:53 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:43.972 18:07:53 -- common/autotest_common.sh@10 -- # set +x 00:19:50.570 18:07:59 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:50.570 18:07:59 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:50.570 18:07:59 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:50.570 18:07:59 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:50.570 18:07:59 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:50.570 18:07:59 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:50.570 18:07:59 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:50.570 18:07:59 -- nvmf/common.sh@295 -- # net_devs=() 00:19:50.570 18:07:59 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:50.570 18:07:59 -- nvmf/common.sh@296 -- # e810=() 00:19:50.570 18:07:59 -- nvmf/common.sh@296 -- # local -ga e810 00:19:50.570 18:07:59 -- nvmf/common.sh@297 -- # x722=() 00:19:50.570 18:07:59 -- nvmf/common.sh@297 -- # local -ga x722 00:19:50.570 18:07:59 -- nvmf/common.sh@298 -- # mlx=() 00:19:50.570 18:07:59 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:50.570 18:07:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:50.570 18:07:59 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:50.570 18:07:59 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:50.570 18:07:59 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:50.570 18:07:59 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:50.570 18:07:59 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:50.571 18:07:59 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:50.571 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:50.571 18:07:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:50.571 18:07:59 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:50.571 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:50.571 18:07:59 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:50.571 18:07:59 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.571 18:07:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.571 18:07:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:50.571 Found net devices under 0000:18:00.0: mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.571 18:07:59 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.571 18:07:59 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:50.571 Found net devices under 0000:18:00.1: mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.571 18:07:59 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:50.571 18:07:59 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:50.571 18:07:59 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:50.571 18:07:59 -- nvmf/common.sh@58 -- # uname 00:19:50.571 18:07:59 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:50.571 18:07:59 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:50.571 18:07:59 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:50.571 18:07:59 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:50.571 18:07:59 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:50.571 18:07:59 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:50.571 18:07:59 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:50.571 18:07:59 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:50.571 18:07:59 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:50.571 18:07:59 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:50.571 18:07:59 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:50.571 18:07:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:50.571 18:07:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:50.571 18:07:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:50.571 18:07:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:50.571 18:07:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@105 -- # continue 2 00:19:50.571 18:07:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@105 -- # continue 2 00:19:50.571 18:07:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:50.571 18:07:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:50.571 18:07:59 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:50.571 18:07:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:50.571 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:50.571 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:50.571 altname enp24s0f0np0 00:19:50.571 altname ens785f0np0 00:19:50.571 inet 192.168.100.8/24 scope global mlx_0_0 00:19:50.571 valid_lft forever preferred_lft forever 00:19:50.571 18:07:59 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:50.571 18:07:59 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:50.571 18:07:59 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:50.571 18:07:59 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:50.571 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:50.571 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:50.571 altname enp24s0f1np1 00:19:50.571 altname ens785f1np1 00:19:50.571 inet 192.168.100.9/24 scope global mlx_0_1 00:19:50.571 valid_lft forever preferred_lft forever 00:19:50.571 18:07:59 -- nvmf/common.sh@411 -- # return 0 00:19:50.571 18:07:59 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:50.571 18:07:59 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:50.571 18:07:59 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:50.571 18:07:59 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:50.571 18:07:59 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:50.571 18:07:59 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:50.571 18:07:59 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:50.571 18:07:59 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:50.571 18:07:59 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:50.571 18:07:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@105 -- # continue 2 00:19:50.571 18:07:59 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:50.571 18:07:59 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:50.571 18:07:59 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@105 -- # continue 2 00:19:50.571 18:07:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:50.571 18:07:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:50.571 18:07:59 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:50.571 18:07:59 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:50.571 18:07:59 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:50.571 18:07:59 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:50.571 192.168.100.9' 00:19:50.571 18:07:59 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:50.571 192.168.100.9' 00:19:50.571 18:07:59 -- nvmf/common.sh@446 -- # head -n 1 00:19:50.571 18:07:59 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:50.571 18:07:59 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:50.571 192.168.100.9' 00:19:50.571 18:07:59 -- nvmf/common.sh@447 -- # tail -n +2 00:19:50.571 18:07:59 -- nvmf/common.sh@447 -- # head -n 1 00:19:50.571 18:07:59 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:50.571 18:07:59 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:50.571 18:07:59 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:50.571 18:07:59 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:50.571 18:07:59 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:50.572 18:07:59 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:50.572 18:07:59 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:19:50.572 18:07:59 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:50.572 18:07:59 -- common/autotest_common.sh@10 -- # set +x 00:19:50.572 18:07:59 -- host/identify.sh@19 -- # nvmfpid=1017714 00:19:50.572 18:07:59 -- host/identify.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:50.572 18:07:59 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:50.572 18:07:59 -- host/identify.sh@23 -- # waitforlisten 1017714 00:19:50.572 18:07:59 -- common/autotest_common.sh@827 -- # '[' -z 1017714 ']' 00:19:50.572 18:07:59 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:50.572 18:07:59 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:50.572 18:07:59 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:50.572 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:50.572 18:07:59 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:50.572 18:07:59 -- common/autotest_common.sh@10 -- # set +x 00:19:50.572 [2024-04-26 18:07:59.389366] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:50.572 [2024-04-26 18:07:59.389428] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:50.572 EAL: No free 2048 kB hugepages reported on node 1 00:19:50.572 [2024-04-26 18:07:59.461522] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:50.572 [2024-04-26 18:07:59.547798] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:50.572 [2024-04-26 18:07:59.547846] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:50.572 [2024-04-26 18:07:59.547856] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:50.572 [2024-04-26 18:07:59.547881] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:50.572 [2024-04-26 18:07:59.547888] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:50.572 [2024-04-26 18:07:59.547945] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:50.572 [2024-04-26 18:07:59.548028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:50.572 [2024-04-26 18:07:59.548110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:50.572 [2024-04-26 18:07:59.548112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:51.141 18:08:00 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:51.141 18:08:00 -- common/autotest_common.sh@860 -- # return 0 00:19:51.141 18:08:00 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:19:51.141 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.141 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.141 [2024-04-26 18:08:00.232552] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x6b04d0/0x6b49c0) succeed. 00:19:51.141 [2024-04-26 18:08:00.243064] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x6b1b10/0x6f6050) succeed. 00:19:51.400 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.400 18:08:00 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:19:51.400 18:08:00 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:51.400 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.400 18:08:00 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:51.400 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.400 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.400 Malloc0 00:19:51.400 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.400 18:08:00 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:51.400 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.400 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.400 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.400 18:08:00 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:19:51.400 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.401 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.401 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.401 18:08:00 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:19:51.401 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.401 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.401 [2024-04-26 18:08:00.464136] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:19:51.401 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.401 18:08:00 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:19:51.401 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.401 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.401 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.401 18:08:00 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:19:51.401 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.401 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.401 [2024-04-26 18:08:00.479760] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:19:51.401 [ 00:19:51.401 { 00:19:51.401 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:19:51.401 "subtype": "Discovery", 00:19:51.401 "listen_addresses": [ 00:19:51.401 { 00:19:51.401 "transport": "RDMA", 00:19:51.401 "trtype": "RDMA", 00:19:51.401 "adrfam": "IPv4", 00:19:51.401 "traddr": "192.168.100.8", 00:19:51.401 "trsvcid": "4420" 00:19:51.401 } 00:19:51.401 ], 00:19:51.401 "allow_any_host": true, 00:19:51.401 "hosts": [] 00:19:51.401 }, 00:19:51.401 { 00:19:51.401 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:51.401 "subtype": "NVMe", 00:19:51.401 "listen_addresses": [ 00:19:51.401 { 00:19:51.401 "transport": "RDMA", 00:19:51.401 "trtype": "RDMA", 00:19:51.401 "adrfam": "IPv4", 00:19:51.401 "traddr": "192.168.100.8", 00:19:51.401 "trsvcid": "4420" 00:19:51.401 } 00:19:51.401 ], 00:19:51.401 "allow_any_host": true, 00:19:51.401 "hosts": [], 00:19:51.401 "serial_number": "SPDK00000000000001", 00:19:51.401 "model_number": "SPDK bdev Controller", 00:19:51.401 "max_namespaces": 32, 00:19:51.401 "min_cntlid": 1, 00:19:51.401 "max_cntlid": 65519, 00:19:51.401 "namespaces": [ 00:19:51.401 { 00:19:51.401 "nsid": 1, 00:19:51.401 "bdev_name": "Malloc0", 00:19:51.401 "name": "Malloc0", 00:19:51.401 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:19:51.401 "eui64": "ABCDEF0123456789", 00:19:51.401 "uuid": "095215b9-23d9-4c18-9476-17b0b661c12d" 00:19:51.401 } 00:19:51.401 ] 00:19:51.401 } 00:19:51.401 ] 00:19:51.401 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.401 18:08:00 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:19:51.401 [2024-04-26 18:08:00.525525] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:51.401 [2024-04-26 18:08:00.525566] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017841 ] 00:19:51.401 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.401 [2024-04-26 18:08:00.575811] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:19:51.401 [2024-04-26 18:08:00.575897] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:19:51.401 [2024-04-26 18:08:00.575915] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:19:51.401 [2024-04-26 18:08:00.575920] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:19:51.401 [2024-04-26 18:08:00.575955] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:19:51.401 [2024-04-26 18:08:00.591801] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:19:51.670 [2024-04-26 18:08:00.606651] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:51.670 [2024-04-26 18:08:00.606661] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:19:51.670 [2024-04-26 18:08:00.606669] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606677] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606684] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606690] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606696] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606703] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606709] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606716] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606722] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606728] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606735] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606741] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606748] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606754] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606761] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606767] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606773] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606780] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606786] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606793] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606799] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.670 [2024-04-26 18:08:00.606806] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606815] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606822] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606828] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606835] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606841] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606848] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606854] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606860] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606867] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606873] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:19:51.671 [2024-04-26 18:08:00.606879] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:51.671 [2024-04-26 18:08:00.606883] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:19:51.671 [2024-04-26 18:08:00.606906] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.606921] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183200 00:19:51.671 [2024-04-26 18:08:00.612344] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612364] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612371] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:19:51.671 [2024-04-26 18:08:00.612379] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:19:51.671 [2024-04-26 18:08:00.612386] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:19:51.671 [2024-04-26 18:08:00.612405] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612414] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612440] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612456] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:19:51.671 [2024-04-26 18:08:00.612462] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612469] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:19:51.671 [2024-04-26 18:08:00.612477] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612485] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612501] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612516] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:19:51.671 [2024-04-26 18:08:00.612522] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612530] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612537] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612545] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612561] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612574] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612580] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612589] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612597] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612612] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612625] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:19:51.671 [2024-04-26 18:08:00.612632] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612638] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612645] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612752] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:19:51.671 [2024-04-26 18:08:00.612758] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612769] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612777] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612800] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612812] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:19:51.671 [2024-04-26 18:08:00.612818] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612827] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.671 [2024-04-26 18:08:00.612836] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.671 [2024-04-26 18:08:00.612852] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.671 [2024-04-26 18:08:00.612858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:51.671 [2024-04-26 18:08:00.612864] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:19:51.671 [2024-04-26 18:08:00.612870] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:19:51.671 [2024-04-26 18:08:00.612876] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.612884] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:19:51.672 [2024-04-26 18:08:00.612893] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:19:51.672 [2024-04-26 18:08:00.612903] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.612911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183200 00:19:51.672 [2024-04-26 18:08:00.612950] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.612956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.612966] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:19:51.672 [2024-04-26 18:08:00.612972] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:19:51.672 [2024-04-26 18:08:00.612978] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:19:51.672 [2024-04-26 18:08:00.612988] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:19:51.672 [2024-04-26 18:08:00.612994] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:19:51.672 [2024-04-26 18:08:00.613000] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:19:51.672 [2024-04-26 18:08:00.613006] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613014] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:19:51.672 [2024-04-26 18:08:00.613022] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613030] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.672 [2024-04-26 18:08:00.613049] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613065] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613072] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.672 [2024-04-26 18:08:00.613079] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613088] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.672 [2024-04-26 18:08:00.613095] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.672 [2024-04-26 18:08:00.613109] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.672 [2024-04-26 18:08:00.613123] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:19:51.672 [2024-04-26 18:08:00.613129] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613139] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:19:51.672 [2024-04-26 18:08:00.613147] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613155] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.672 [2024-04-26 18:08:00.613174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613187] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:19:51.672 [2024-04-26 18:08:00.613194] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:19:51.672 [2024-04-26 18:08:00.613200] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613209] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613216] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183200 00:19:51.672 [2024-04-26 18:08:00.613239] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000b p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613252] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613263] nvme_ctrlr.c:4036:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:19:51.672 [2024-04-26 18:08:00.613283] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x400 key:0x183200 00:19:51.672 [2024-04-26 18:08:00.613300] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.672 [2024-04-26 18:08:00.613325] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613351] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613360] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0xc00 key:0x183200 00:19:51.672 [2024-04-26 18:08:00.613366] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613373] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613385] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613391] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613407] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613415] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:0 cdw10:00010070 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x8 key:0x183200 00:19:51.672 [2024-04-26 18:08:00.613421] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.672 [2024-04-26 18:08:00.613437] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.672 [2024-04-26 18:08:00.613442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:19:51.672 [2024-04-26 18:08:00.613454] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.673 ===================================================== 00:19:51.673 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:19:51.673 ===================================================== 00:19:51.673 Controller Capabilities/Features 00:19:51.673 ================================ 00:19:51.673 Vendor ID: 0000 00:19:51.673 Subsystem Vendor ID: 0000 00:19:51.673 Serial Number: .................... 00:19:51.673 Model Number: ........................................ 00:19:51.673 Firmware Version: 24.05 00:19:51.673 Recommended Arb Burst: 0 00:19:51.673 IEEE OUI Identifier: 00 00 00 00:19:51.673 Multi-path I/O 00:19:51.673 May have multiple subsystem ports: No 00:19:51.673 May have multiple controllers: No 00:19:51.673 Associated with SR-IOV VF: No 00:19:51.673 Max Data Transfer Size: 131072 00:19:51.673 Max Number of Namespaces: 0 00:19:51.673 Max Number of I/O Queues: 1024 00:19:51.673 NVMe Specification Version (VS): 1.3 00:19:51.673 NVMe Specification Version (Identify): 1.3 00:19:51.673 Maximum Queue Entries: 128 00:19:51.673 Contiguous Queues Required: Yes 00:19:51.673 Arbitration Mechanisms Supported 00:19:51.673 Weighted Round Robin: Not Supported 00:19:51.673 Vendor Specific: Not Supported 00:19:51.673 Reset Timeout: 15000 ms 00:19:51.673 Doorbell Stride: 4 bytes 00:19:51.673 NVM Subsystem Reset: Not Supported 00:19:51.673 Command Sets Supported 00:19:51.673 NVM Command Set: Supported 00:19:51.673 Boot Partition: Not Supported 00:19:51.673 Memory Page Size Minimum: 4096 bytes 00:19:51.673 Memory Page Size Maximum: 4096 bytes 00:19:51.673 Persistent Memory Region: Not Supported 00:19:51.673 Optional Asynchronous Events Supported 00:19:51.673 Namespace Attribute Notices: Not Supported 00:19:51.673 Firmware Activation Notices: Not Supported 00:19:51.673 ANA Change Notices: Not Supported 00:19:51.673 PLE Aggregate Log Change Notices: Not Supported 00:19:51.673 LBA Status Info Alert Notices: Not Supported 00:19:51.673 EGE Aggregate Log Change Notices: Not Supported 00:19:51.673 Normal NVM Subsystem Shutdown event: Not Supported 00:19:51.673 Zone Descriptor Change Notices: Not Supported 00:19:51.673 Discovery Log Change Notices: Supported 00:19:51.673 Controller Attributes 00:19:51.673 128-bit Host Identifier: Not Supported 00:19:51.673 Non-Operational Permissive Mode: Not Supported 00:19:51.673 NVM Sets: Not Supported 00:19:51.673 Read Recovery Levels: Not Supported 00:19:51.673 Endurance Groups: Not Supported 00:19:51.673 Predictable Latency Mode: Not Supported 00:19:51.673 Traffic Based Keep ALive: Not Supported 00:19:51.673 Namespace Granularity: Not Supported 00:19:51.673 SQ Associations: Not Supported 00:19:51.673 UUID List: Not Supported 00:19:51.673 Multi-Domain Subsystem: Not Supported 00:19:51.673 Fixed Capacity Management: Not Supported 00:19:51.673 Variable Capacity Management: Not Supported 00:19:51.673 Delete Endurance Group: Not Supported 00:19:51.673 Delete NVM Set: Not Supported 00:19:51.673 Extended LBA Formats Supported: Not Supported 00:19:51.673 Flexible Data Placement Supported: Not Supported 00:19:51.673 00:19:51.673 Controller Memory Buffer Support 00:19:51.673 ================================ 00:19:51.673 Supported: No 00:19:51.673 00:19:51.673 Persistent Memory Region Support 00:19:51.673 ================================ 00:19:51.673 Supported: No 00:19:51.673 00:19:51.673 Admin Command Set Attributes 00:19:51.673 ============================ 00:19:51.673 Security Send/Receive: Not Supported 00:19:51.673 Format NVM: Not Supported 00:19:51.673 Firmware Activate/Download: Not Supported 00:19:51.673 Namespace Management: Not Supported 00:19:51.673 Device Self-Test: Not Supported 00:19:51.673 Directives: Not Supported 00:19:51.673 NVMe-MI: Not Supported 00:19:51.673 Virtualization Management: Not Supported 00:19:51.673 Doorbell Buffer Config: Not Supported 00:19:51.673 Get LBA Status Capability: Not Supported 00:19:51.673 Command & Feature Lockdown Capability: Not Supported 00:19:51.673 Abort Command Limit: 1 00:19:51.673 Async Event Request Limit: 4 00:19:51.673 Number of Firmware Slots: N/A 00:19:51.673 Firmware Slot 1 Read-Only: N/A 00:19:51.673 Firmware Activation Without Reset: N/A 00:19:51.673 Multiple Update Detection Support: N/A 00:19:51.673 Firmware Update Granularity: No Information Provided 00:19:51.673 Per-Namespace SMART Log: No 00:19:51.673 Asymmetric Namespace Access Log Page: Not Supported 00:19:51.673 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:19:51.673 Command Effects Log Page: Not Supported 00:19:51.673 Get Log Page Extended Data: Supported 00:19:51.673 Telemetry Log Pages: Not Supported 00:19:51.673 Persistent Event Log Pages: Not Supported 00:19:51.673 Supported Log Pages Log Page: May Support 00:19:51.673 Commands Supported & Effects Log Page: Not Supported 00:19:51.673 Feature Identifiers & Effects Log Page:May Support 00:19:51.673 NVMe-MI Commands & Effects Log Page: May Support 00:19:51.673 Data Area 4 for Telemetry Log: Not Supported 00:19:51.673 Error Log Page Entries Supported: 128 00:19:51.673 Keep Alive: Not Supported 00:19:51.673 00:19:51.673 NVM Command Set Attributes 00:19:51.673 ========================== 00:19:51.673 Submission Queue Entry Size 00:19:51.673 Max: 1 00:19:51.673 Min: 1 00:19:51.673 Completion Queue Entry Size 00:19:51.673 Max: 1 00:19:51.673 Min: 1 00:19:51.673 Number of Namespaces: 0 00:19:51.673 Compare Command: Not Supported 00:19:51.673 Write Uncorrectable Command: Not Supported 00:19:51.673 Dataset Management Command: Not Supported 00:19:51.673 Write Zeroes Command: Not Supported 00:19:51.673 Set Features Save Field: Not Supported 00:19:51.673 Reservations: Not Supported 00:19:51.674 Timestamp: Not Supported 00:19:51.674 Copy: Not Supported 00:19:51.674 Volatile Write Cache: Not Present 00:19:51.674 Atomic Write Unit (Normal): 1 00:19:51.674 Atomic Write Unit (PFail): 1 00:19:51.674 Atomic Compare & Write Unit: 1 00:19:51.674 Fused Compare & Write: Supported 00:19:51.674 Scatter-Gather List 00:19:51.674 SGL Command Set: Supported 00:19:51.674 SGL Keyed: Supported 00:19:51.674 SGL Bit Bucket Descriptor: Not Supported 00:19:51.674 SGL Metadata Pointer: Not Supported 00:19:51.674 Oversized SGL: Not Supported 00:19:51.674 SGL Metadata Address: Not Supported 00:19:51.674 SGL Offset: Supported 00:19:51.674 Transport SGL Data Block: Not Supported 00:19:51.674 Replay Protected Memory Block: Not Supported 00:19:51.674 00:19:51.674 Firmware Slot Information 00:19:51.674 ========================= 00:19:51.674 Active slot: 0 00:19:51.674 00:19:51.674 00:19:51.674 Error Log 00:19:51.674 ========= 00:19:51.674 00:19:51.674 Active Namespaces 00:19:51.674 ================= 00:19:51.674 Discovery Log Page 00:19:51.674 ================== 00:19:51.674 Generation Counter: 2 00:19:51.674 Number of Records: 2 00:19:51.674 Record Format: 0 00:19:51.674 00:19:51.674 Discovery Log Entry 0 00:19:51.674 ---------------------- 00:19:51.674 Transport Type: 1 (RDMA) 00:19:51.674 Address Family: 1 (IPv4) 00:19:51.674 Subsystem Type: 3 (Current Discovery Subsystem) 00:19:51.674 Entry Flags: 00:19:51.674 Duplicate Returned Information: 1 00:19:51.674 Explicit Persistent Connection Support for Discovery: 1 00:19:51.674 Transport Requirements: 00:19:51.674 Secure Channel: Not Required 00:19:51.674 Port ID: 0 (0x0000) 00:19:51.674 Controller ID: 65535 (0xffff) 00:19:51.674 Admin Max SQ Size: 128 00:19:51.674 Transport Service Identifier: 4420 00:19:51.674 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:19:51.674 Transport Address: 192.168.100.8 00:19:51.674 Transport Specific Address Subtype - RDMA 00:19:51.674 RDMA QP Service Type: 1 (Reliable Connected) 00:19:51.674 RDMA Provider Type: 1 (No provider specified) 00:19:51.674 RDMA CM Service: 1 (RDMA_CM) 00:19:51.674 Discovery Log Entry 1 00:19:51.674 ---------------------- 00:19:51.674 Transport Type: 1 (RDMA) 00:19:51.674 Address Family: 1 (IPv4) 00:19:51.674 Subsystem Type: 2 (NVM Subsystem) 00:19:51.674 Entry Flags: 00:19:51.674 Duplicate Returned Information: 0 00:19:51.674 Explicit Persistent Connection Support for Discovery: 0 00:19:51.674 Transport Requirements: 00:19:51.674 Secure Channel: Not Required 00:19:51.674 Port ID: 0 (0x0000) 00:19:51.674 Controller ID: 65535 (0xffff) 00:19:51.674 Admin Max SQ Size: [2024-04-26 18:08:00.613534] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:19:51.674 [2024-04-26 18:08:00.613545] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3688 doesn't match qid 00:19:51.674 [2024-04-26 18:08:00.613559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32688 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613566] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3688 doesn't match qid 00:19:51.674 [2024-04-26 18:08:00.613574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32688 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613581] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3688 doesn't match qid 00:19:51.674 [2024-04-26 18:08:00.613589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32688 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613595] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 3688 doesn't match qid 00:19:51.674 [2024-04-26 18:08:00.613603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32688 cdw0:5 sqhd:7790 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613612] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613621] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.674 [2024-04-26 18:08:00.613636] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.674 [2024-04-26 18:08:00.613641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0010 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613653] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613661] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.674 [2024-04-26 18:08:00.613669] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613684] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.674 [2024-04-26 18:08:00.613689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613697] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:19:51.674 [2024-04-26 18:08:00.613703] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:19:51.674 [2024-04-26 18:08:00.613709] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613718] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613726] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.674 [2024-04-26 18:08:00.613742] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.674 [2024-04-26 18:08:00.613748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613755] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613764] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.674 [2024-04-26 18:08:00.613772] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.674 [2024-04-26 18:08:00.613796] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.674 [2024-04-26 18:08:00.613802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:51.674 [2024-04-26 18:08:00.613808] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613818] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613826] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.613843] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.613849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.613855] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613864] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613872] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.613888] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.613894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.613900] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613909] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.613937] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.613945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.613952] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613961] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.613968] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.613986] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.613992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.613999] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614008] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614016] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614037] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614050] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614059] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614066] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614084] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614096] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614105] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614113] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614129] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614142] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614151] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614158] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614174] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614186] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614195] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614203] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614224] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614239] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614247] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614269] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614282] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614290] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614298] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614320] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614332] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614347] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614355] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614371] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614383] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614392] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614400] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.675 [2024-04-26 18:08:00.614418] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.675 [2024-04-26 18:08:00.614424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:51.675 [2024-04-26 18:08:00.614430] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.675 [2024-04-26 18:08:00.614439] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614447] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614472] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614485] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614493] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614501] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614525] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614537] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614546] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614554] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614577] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614589] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614598] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614606] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614626] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614638] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614647] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614655] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614672] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614684] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614693] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614701] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614724] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614736] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614745] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614753] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614774] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614787] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614796] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614803] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614817] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614830] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614839] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614846] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614862] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614874] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614883] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614914] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614926] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614935] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614943] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.614959] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.614964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.614971] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614980] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.614988] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.615009] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.615015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.615021] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.615030] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.615038] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.615055] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.615061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.615068] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.615076] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.676 [2024-04-26 18:08:00.615086] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.676 [2024-04-26 18:08:00.615105] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.676 [2024-04-26 18:08:00.615111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:19:51.676 [2024-04-26 18:08:00.615117] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615126] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615134] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615157] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615169] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615178] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615186] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615209] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615222] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615230] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615238] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615258] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615270] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615279] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615287] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615302] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615315] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615324] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615331] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615355] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615367] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615376] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615409] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615421] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615430] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615438] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615455] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615468] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615476] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615502] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615514] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615523] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615547] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615559] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615568] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615575] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615595] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615607] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615616] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615624] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615641] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615654] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615662] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615672] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615693] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615705] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615714] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615722] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615741] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615754] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615763] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615770] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615788] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615800] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615809] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615817] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615838] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615851] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615859] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615867] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615888] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615901] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615910] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615917] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615933] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615945] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615956] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.615964] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.677 [2024-04-26 18:08:00.615979] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.677 [2024-04-26 18:08:00.615985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:51.677 [2024-04-26 18:08:00.615992] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.677 [2024-04-26 18:08:00.616000] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616008] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616032] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616044] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616053] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616060] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616080] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616092] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616101] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616109] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616124] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616137] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616146] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616153] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616169] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616181] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616190] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616198] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616215] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616230] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616239] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616246] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616266] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616278] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616287] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.616295] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.616316] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.616322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.616328] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.620344] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.620354] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.678 [2024-04-26 18:08:00.620372] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.678 [2024-04-26 18:08:00.620377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0008 p:0 m:0 dnr:0 00:19:51.678 [2024-04-26 18:08:00.620384] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.620391] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:19:51.678 128 00:19:51.678 Transport Service Identifier: 4420 00:19:51.678 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:19:51.678 Transport Address: 192.168.100.8 00:19:51.678 Transport Specific Address Subtype - RDMA 00:19:51.678 RDMA QP Service Type: 1 (Reliable Connected) 00:19:51.678 RDMA Provider Type: 1 (No provider specified) 00:19:51.678 RDMA CM Service: 1 (RDMA_CM) 00:19:51.678 18:08:00 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:19:51.678 [2024-04-26 18:08:00.694151] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:51.678 [2024-04-26 18:08:00.694201] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1017919 ] 00:19:51.678 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.678 [2024-04-26 18:08:00.745245] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:19:51.678 [2024-04-26 18:08:00.745316] nvme_rdma.c:2261:nvme_rdma_ctrlr_construct: *DEBUG*: successfully initialized the nvmf ctrlr 00:19:51.678 [2024-04-26 18:08:00.745342] nvme_rdma.c:1291:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: adrfam 1 ai_family 2 00:19:51.678 [2024-04-26 18:08:00.745349] nvme_rdma.c:1295:nvme_rdma_ctrlr_connect_qpair: *DEBUG*: trsvcid is 4420 00:19:51.678 [2024-04-26 18:08:00.745374] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:19:51.678 [2024-04-26 18:08:00.760896] nvme_rdma.c: 510:nvme_rdma_qpair_process_cm_event: *DEBUG*: Requested queue depth 32. Target receive queue depth 32. 00:19:51.678 [2024-04-26 18:08:00.774637] nvme_rdma.c:1180:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:51.678 [2024-04-26 18:08:00.774648] nvme_rdma.c:1185:nvme_rdma_connect_established: *DEBUG*: RDMA requests created 00:19:51.678 [2024-04-26 18:08:00.774656] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774663] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774670] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774676] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774683] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774689] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774696] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774702] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774709] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774715] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774722] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774728] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774735] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774741] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774748] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774754] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774761] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774767] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774774] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774780] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774787] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774793] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774800] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774806] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774813] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774819] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774825] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774835] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774841] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774848] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774854] nvme_rdma.c: 968:nvme_rdma_create_rsps: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.678 [2024-04-26 18:08:00.774860] nvme_rdma.c:1199:nvme_rdma_connect_established: *DEBUG*: RDMA responses created 00:19:51.678 [2024-04-26 18:08:00.774866] nvme_rdma.c:1202:nvme_rdma_connect_established: *DEBUG*: rc =0 00:19:51.678 [2024-04-26 18:08:00.774871] nvme_rdma.c:1207:nvme_rdma_connect_established: *DEBUG*: RDMA responses submitted 00:19:51.678 [2024-04-26 18:08:00.774887] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.774901] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf200 len:0x400 key:0x183200 00:19:51.679 [2024-04-26 18:08:00.780341] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780361] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780368] nvme_fabric.c: 622:_nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:19:51.679 [2024-04-26 18:08:00.780375] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780382] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780397] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780406] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780426] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:10300 sqhd:0002 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780441] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780447] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780454] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780462] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780470] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780492] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1e01007f sqhd:0003 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780505] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780511] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780519] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780526] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780536] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780552] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0004 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780565] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780571] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780580] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780588] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780608] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0005 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780621] nvme_ctrlr.c:3749:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:19:51.679 [2024-04-26 18:08:00.780627] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780633] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780640] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780747] nvme_ctrlr.c:3942:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:19:51.679 [2024-04-26 18:08:00.780752] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780761] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780785] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0006 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780798] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:19:51.679 [2024-04-26 18:08:00.780804] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780812] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780820] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.780838] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780850] nvme_ctrlr.c:3784:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:19:51.679 [2024-04-26 18:08:00.780857] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.780863] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780872] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:19:51.679 [2024-04-26 18:08:00.780885] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.780895] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.780903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183200 00:19:51.679 [2024-04-26 18:08:00.780944] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.780950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0008 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.780959] nvme_ctrlr.c:1984:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:19:51.679 [2024-04-26 18:08:00.780965] nvme_ctrlr.c:1988:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:19:51.679 [2024-04-26 18:08:00.780971] nvme_ctrlr.c:1991:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:19:51.679 [2024-04-26 18:08:00.780980] nvme_ctrlr.c:2015:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:19:51.679 [2024-04-26 18:08:00.780986] nvme_ctrlr.c:2030:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:19:51.679 [2024-04-26 18:08:00.780992] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.780998] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781006] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.781014] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781022] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.781044] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.781050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0009 p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.781059] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0500 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781066] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.679 [2024-04-26 18:08:00.781074] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0640 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.679 [2024-04-26 18:08:00.781088] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781095] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.679 [2024-04-26 18:08:00.781103] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781110] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.679 [2024-04-26 18:08:00.781116] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.781123] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781134] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.781142] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.679 [2024-04-26 18:08:00.781150] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:0 cdw10:0000000f SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.679 [2024-04-26 18:08:00.781168] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.679 [2024-04-26 18:08:00.781174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:2710 sqhd:000a p:0 m:0 dnr:0 00:19:51.679 [2024-04-26 18:08:00.781180] nvme_ctrlr.c:2902:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:19:51.679 [2024-04-26 18:08:00.781187] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:19:51.679 [2024-04-26 18:08:00.781193] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781200] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781208] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781216] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781223] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:0 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.680 [2024-04-26 18:08:00.781243] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:7e007e sqhd:000b p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781291] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781297] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781305] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781314] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781322] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cc000 len:0x1000 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781350] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781367] nvme_ctrlr.c:4557:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:19:51.680 [2024-04-26 18:08:00.781377] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781384] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781392] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781401] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781410] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000000 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781445] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000d p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781466] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781473] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781481] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781490] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:1 cdw10:00000003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x1000 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781521] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000e p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781537] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781543] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781550] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781560] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781568] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781574] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781581] nvme_ctrlr.c:2990:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:19:51.680 [2024-04-26 18:08:00.781587] nvme_ctrlr.c:1484:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:19:51.680 [2024-04-26 18:08:00.781594] nvme_ctrlr.c:1490:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:19:51.680 [2024-04-26 18:08:00.781609] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781617] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:0 cdw10:00000001 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.680 [2024-04-26 18:08:00.781625] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:19:51.680 [2024-04-26 18:08:00.781643] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:000f p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781656] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781662] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0010 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781675] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781685] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781693] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.680 [2024-04-26 18:08:00.781713] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0011 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781726] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781735] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781742] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.680 [2024-04-26 18:08:00.781765] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0012 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781777] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781787] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781794] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.680 [2024-04-26 18:08:00.781814] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:7e007e sqhd:0013 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781827] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781838] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0a00 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781846] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c9000 len:0x2000 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781854] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d03c0 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:0 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003cf000 len:0x200 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781871] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0b40 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781878] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003ce000 len:0x200 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781887] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781895] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL KEYED DATA BLOCK ADDRESS 0x2000003c7000 len:0x1000 key:0x183200 00:19:51.680 [2024-04-26 18:08:00.781904] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:5 cdw0:0 sqhd:0014 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781925] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781932] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:0 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781947] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781953] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:6 cdw0:0 sqhd:0016 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781966] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.680 [2024-04-26 18:08:00.781973] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.680 [2024-04-26 18:08:00.781978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0017 p:0 m:0 dnr:0 00:19:51.680 [2024-04-26 18:08:00.781989] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.680 ===================================================== 00:19:51.680 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:19:51.680 ===================================================== 00:19:51.680 Controller Capabilities/Features 00:19:51.680 ================================ 00:19:51.680 Vendor ID: 8086 00:19:51.680 Subsystem Vendor ID: 8086 00:19:51.681 Serial Number: SPDK00000000000001 00:19:51.681 Model Number: SPDK bdev Controller 00:19:51.681 Firmware Version: 24.05 00:19:51.681 Recommended Arb Burst: 6 00:19:51.681 IEEE OUI Identifier: e4 d2 5c 00:19:51.681 Multi-path I/O 00:19:51.681 May have multiple subsystem ports: Yes 00:19:51.681 May have multiple controllers: Yes 00:19:51.681 Associated with SR-IOV VF: No 00:19:51.681 Max Data Transfer Size: 131072 00:19:51.681 Max Number of Namespaces: 32 00:19:51.681 Max Number of I/O Queues: 127 00:19:51.681 NVMe Specification Version (VS): 1.3 00:19:51.681 NVMe Specification Version (Identify): 1.3 00:19:51.681 Maximum Queue Entries: 128 00:19:51.681 Contiguous Queues Required: Yes 00:19:51.681 Arbitration Mechanisms Supported 00:19:51.681 Weighted Round Robin: Not Supported 00:19:51.681 Vendor Specific: Not Supported 00:19:51.681 Reset Timeout: 15000 ms 00:19:51.681 Doorbell Stride: 4 bytes 00:19:51.681 NVM Subsystem Reset: Not Supported 00:19:51.681 Command Sets Supported 00:19:51.681 NVM Command Set: Supported 00:19:51.681 Boot Partition: Not Supported 00:19:51.681 Memory Page Size Minimum: 4096 bytes 00:19:51.681 Memory Page Size Maximum: 4096 bytes 00:19:51.681 Persistent Memory Region: Not Supported 00:19:51.681 Optional Asynchronous Events Supported 00:19:51.681 Namespace Attribute Notices: Supported 00:19:51.681 Firmware Activation Notices: Not Supported 00:19:51.681 ANA Change Notices: Not Supported 00:19:51.681 PLE Aggregate Log Change Notices: Not Supported 00:19:51.681 LBA Status Info Alert Notices: Not Supported 00:19:51.681 EGE Aggregate Log Change Notices: Not Supported 00:19:51.681 Normal NVM Subsystem Shutdown event: Not Supported 00:19:51.681 Zone Descriptor Change Notices: Not Supported 00:19:51.681 Discovery Log Change Notices: Not Supported 00:19:51.681 Controller Attributes 00:19:51.681 128-bit Host Identifier: Supported 00:19:51.681 Non-Operational Permissive Mode: Not Supported 00:19:51.681 NVM Sets: Not Supported 00:19:51.681 Read Recovery Levels: Not Supported 00:19:51.681 Endurance Groups: Not Supported 00:19:51.681 Predictable Latency Mode: Not Supported 00:19:51.681 Traffic Based Keep ALive: Not Supported 00:19:51.681 Namespace Granularity: Not Supported 00:19:51.681 SQ Associations: Not Supported 00:19:51.681 UUID List: Not Supported 00:19:51.681 Multi-Domain Subsystem: Not Supported 00:19:51.681 Fixed Capacity Management: Not Supported 00:19:51.681 Variable Capacity Management: Not Supported 00:19:51.681 Delete Endurance Group: Not Supported 00:19:51.681 Delete NVM Set: Not Supported 00:19:51.681 Extended LBA Formats Supported: Not Supported 00:19:51.681 Flexible Data Placement Supported: Not Supported 00:19:51.681 00:19:51.681 Controller Memory Buffer Support 00:19:51.681 ================================ 00:19:51.681 Supported: No 00:19:51.681 00:19:51.681 Persistent Memory Region Support 00:19:51.681 ================================ 00:19:51.681 Supported: No 00:19:51.681 00:19:51.681 Admin Command Set Attributes 00:19:51.681 ============================ 00:19:51.681 Security Send/Receive: Not Supported 00:19:51.681 Format NVM: Not Supported 00:19:51.681 Firmware Activate/Download: Not Supported 00:19:51.681 Namespace Management: Not Supported 00:19:51.681 Device Self-Test: Not Supported 00:19:51.681 Directives: Not Supported 00:19:51.681 NVMe-MI: Not Supported 00:19:51.681 Virtualization Management: Not Supported 00:19:51.681 Doorbell Buffer Config: Not Supported 00:19:51.681 Get LBA Status Capability: Not Supported 00:19:51.681 Command & Feature Lockdown Capability: Not Supported 00:19:51.681 Abort Command Limit: 4 00:19:51.681 Async Event Request Limit: 4 00:19:51.681 Number of Firmware Slots: N/A 00:19:51.681 Firmware Slot 1 Read-Only: N/A 00:19:51.681 Firmware Activation Without Reset: N/A 00:19:51.681 Multiple Update Detection Support: N/A 00:19:51.681 Firmware Update Granularity: No Information Provided 00:19:51.681 Per-Namespace SMART Log: No 00:19:51.681 Asymmetric Namespace Access Log Page: Not Supported 00:19:51.681 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:19:51.681 Command Effects Log Page: Supported 00:19:51.681 Get Log Page Extended Data: Supported 00:19:51.681 Telemetry Log Pages: Not Supported 00:19:51.681 Persistent Event Log Pages: Not Supported 00:19:51.681 Supported Log Pages Log Page: May Support 00:19:51.681 Commands Supported & Effects Log Page: Not Supported 00:19:51.681 Feature Identifiers & Effects Log Page:May Support 00:19:51.681 NVMe-MI Commands & Effects Log Page: May Support 00:19:51.681 Data Area 4 for Telemetry Log: Not Supported 00:19:51.681 Error Log Page Entries Supported: 128 00:19:51.681 Keep Alive: Supported 00:19:51.681 Keep Alive Granularity: 10000 ms 00:19:51.681 00:19:51.681 NVM Command Set Attributes 00:19:51.681 ========================== 00:19:51.681 Submission Queue Entry Size 00:19:51.681 Max: 64 00:19:51.681 Min: 64 00:19:51.681 Completion Queue Entry Size 00:19:51.681 Max: 16 00:19:51.681 Min: 16 00:19:51.681 Number of Namespaces: 32 00:19:51.681 Compare Command: Supported 00:19:51.681 Write Uncorrectable Command: Not Supported 00:19:51.681 Dataset Management Command: Supported 00:19:51.681 Write Zeroes Command: Supported 00:19:51.681 Set Features Save Field: Not Supported 00:19:51.681 Reservations: Supported 00:19:51.681 Timestamp: Not Supported 00:19:51.681 Copy: Supported 00:19:51.681 Volatile Write Cache: Present 00:19:51.681 Atomic Write Unit (Normal): 1 00:19:51.681 Atomic Write Unit (PFail): 1 00:19:51.681 Atomic Compare & Write Unit: 1 00:19:51.681 Fused Compare & Write: Supported 00:19:51.681 Scatter-Gather List 00:19:51.681 SGL Command Set: Supported 00:19:51.681 SGL Keyed: Supported 00:19:51.681 SGL Bit Bucket Descriptor: Not Supported 00:19:51.681 SGL Metadata Pointer: Not Supported 00:19:51.681 Oversized SGL: Not Supported 00:19:51.681 SGL Metadata Address: Not Supported 00:19:51.681 SGL Offset: Supported 00:19:51.681 Transport SGL Data Block: Not Supported 00:19:51.681 Replay Protected Memory Block: Not Supported 00:19:51.681 00:19:51.681 Firmware Slot Information 00:19:51.681 ========================= 00:19:51.681 Active slot: 1 00:19:51.681 Slot 1 Firmware Revision: 24.05 00:19:51.681 00:19:51.681 00:19:51.681 Commands Supported and Effects 00:19:51.681 ============================== 00:19:51.681 Admin Commands 00:19:51.681 -------------- 00:19:51.681 Get Log Page (02h): Supported 00:19:51.681 Identify (06h): Supported 00:19:51.681 Abort (08h): Supported 00:19:51.681 Set Features (09h): Supported 00:19:51.681 Get Features (0Ah): Supported 00:19:51.681 Asynchronous Event Request (0Ch): Supported 00:19:51.681 Keep Alive (18h): Supported 00:19:51.681 I/O Commands 00:19:51.681 ------------ 00:19:51.681 Flush (00h): Supported LBA-Change 00:19:51.681 Write (01h): Supported LBA-Change 00:19:51.681 Read (02h): Supported 00:19:51.681 Compare (05h): Supported 00:19:51.681 Write Zeroes (08h): Supported LBA-Change 00:19:51.681 Dataset Management (09h): Supported LBA-Change 00:19:51.681 Copy (19h): Supported LBA-Change 00:19:51.681 Unknown (79h): Supported LBA-Change 00:19:51.681 Unknown (7Ah): Supported 00:19:51.681 00:19:51.681 Error Log 00:19:51.681 ========= 00:19:51.681 00:19:51.681 Arbitration 00:19:51.681 =========== 00:19:51.681 Arbitration Burst: 1 00:19:51.681 00:19:51.681 Power Management 00:19:51.681 ================ 00:19:51.681 Number of Power States: 1 00:19:51.681 Current Power State: Power State #0 00:19:51.681 Power State #0: 00:19:51.682 Max Power: 0.00 W 00:19:51.682 Non-Operational State: Operational 00:19:51.682 Entry Latency: Not Reported 00:19:51.682 Exit Latency: Not Reported 00:19:51.682 Relative Read Throughput: 0 00:19:51.682 Relative Read Latency: 0 00:19:51.682 Relative Write Throughput: 0 00:19:51.682 Relative Write Latency: 0 00:19:51.682 Idle Power: Not Reported 00:19:51.682 Active Power: Not Reported 00:19:51.682 Non-Operational Permissive Mode: Not Supported 00:19:51.682 00:19:51.682 Health Information 00:19:51.682 ================== 00:19:51.682 Critical Warnings: 00:19:51.682 Available Spare Space: OK 00:19:51.682 Temperature: OK 00:19:51.682 Device Reliability: OK 00:19:51.682 Read Only: No 00:19:51.682 Volatile Memory Backup: OK 00:19:51.682 Current Temperature: 0 Kelvin (-273 Celsius) 00:19:51.682 Temperature Threshold: [2024-04-26 18:08:00.782074] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0c80 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782082] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782099] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:7 cdw0:0 sqhd:0018 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782112] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782136] nvme_ctrlr.c:4221:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:19:51.682 [2024-04-26 18:08:00.782145] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34425 doesn't match qid 00:19:51.682 [2024-04-26 18:08:00.782159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32682 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782166] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34425 doesn't match qid 00:19:51.682 [2024-04-26 18:08:00.782174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32682 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782181] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34425 doesn't match qid 00:19:51.682 [2024-04-26 18:08:00.782189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32682 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782195] nvme_qpair.c: 471:spdk_nvme_print_completion: *ERROR*: sqid 34425 doesn't match qid 00:19:51.682 [2024-04-26 18:08:00.782204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:32682 cdw0:5 sqhd:d790 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782213] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d08c0 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782221] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:4 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782241] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:4 cdw0:460001 sqhd:0019 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782256] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782272] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782284] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:0 sqhd:001a p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782297] nvme_ctrlr.c:1082:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:19:51.682 [2024-04-26 18:08:00.782304] nvme_ctrlr.c:1085:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:19:51.682 [2024-04-26 18:08:00.782310] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782319] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782327] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782353] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782366] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782375] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782383] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782401] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782414] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782423] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782431] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782453] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782465] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782474] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782482] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782504] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782516] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782525] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782533] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782549] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782563] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782572] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782580] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782596] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782609] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782618] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782626] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782647] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782660] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782669] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782694] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782707] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782716] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782724] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782740] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782752] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782761] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782787] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782799] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782808] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.682 [2024-04-26 18:08:00.782816] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.682 [2024-04-26 18:08:00.782835] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.682 [2024-04-26 18:08:00.782841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:51.682 [2024-04-26 18:08:00.782847] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782856] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782864] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.782882] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.782887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0006 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.782894] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782903] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782910] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.782930] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.782936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0007 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.782942] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782951] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.782959] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.782980] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.782986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0008 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.782993] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7c0 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783002] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783009] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783027] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0009 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783039] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf7e8 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783048] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783056] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783075] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000a p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783088] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf810 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783096] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783104] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783119] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000b p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783132] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf838 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783141] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783149] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783170] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000c p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783182] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf860 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783191] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783199] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783217] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000d p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783229] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf888 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783238] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783267] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000e p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783279] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8b0 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783288] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783296] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783315] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:000f p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783327] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf8d8 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783340] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783348] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783362] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0010 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783374] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf900 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783383] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783391] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783408] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0011 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783420] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf928 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783429] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783437] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783454] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0012 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783467] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf950 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783476] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783483] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783499] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0013 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783511] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf978 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783520] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783528] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783546] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0014 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783558] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9a0 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783567] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783575] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783596] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0015 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783608] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9c8 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783617] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783625] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783643] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0016 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783655] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf9f0 length 0x10 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783664] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.683 [2024-04-26 18:08:00.783673] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.683 [2024-04-26 18:08:00.783691] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.683 [2024-04-26 18:08:00.783696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0017 p:0 m:0 dnr:0 00:19:51.683 [2024-04-26 18:08:00.783703] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa18 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783712] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783720] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783737] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0018 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783749] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa40 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783758] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783766] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783782] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0019 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783794] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa68 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783803] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783811] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783825] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001a p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783837] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfa90 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783846] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783853] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783873] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001b p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783885] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfab8 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783894] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783902] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783925] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001c p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783937] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfae0 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783946] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783956] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.783977] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.783983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001d p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.783989] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb08 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.783998] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784006] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784022] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001e p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784034] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cfb30 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784043] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784051] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784068] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:001f p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784081] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf680 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784089] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784097] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784113] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0000 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784125] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6a8 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784134] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784142] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784164] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0001 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784176] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6d0 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784185] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784210] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0002 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784222] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf6f8 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784233] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784241] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784258] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0003 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784270] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf720 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784279] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784287] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.784305] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.784311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0004 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.784317] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf748 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784326] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.784334] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.788350] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.788356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:1 sqhd:0005 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.788363] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf770 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.788372] nvme_rdma.c:2340:nvme_rdma_qpair_submit_request: *DEBUG*: local addr 0x2000003d0780 length 0x40 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.788380] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL KEYED DATA BLOCK ADDRESS 0x0 len:0x0 key:0x0 00:19:51.684 [2024-04-26 18:08:00.788398] nvme_rdma.c:2543:nvme_rdma_process_recv_completion: *DEBUG*: CQ recv completion 00:19:51.684 [2024-04-26 18:08:00.788404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:3 cdw0:9 sqhd:0006 p:0 m:0 dnr:0 00:19:51.684 [2024-04-26 18:08:00.788410] nvme_rdma.c:2436:nvme_rdma_request_ready: *DEBUG*: local addr 0x2000003cf798 length 0x10 lkey 0x183200 00:19:51.684 [2024-04-26 18:08:00.788418] nvme_ctrlr.c:1204:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:19:51.684 0 Kelvin (-273 Celsius) 00:19:51.684 Available Spare: 0% 00:19:51.684 Available Spare Threshold: 0% 00:19:51.684 Life Percentage Used: 0% 00:19:51.684 Data Units Read: 0 00:19:51.684 Data Units Written: 0 00:19:51.684 Host Read Commands: 0 00:19:51.684 Host Write Commands: 0 00:19:51.684 Controller Busy Time: 0 minutes 00:19:51.684 Power Cycles: 0 00:19:51.684 Power On Hours: 0 hours 00:19:51.684 Unsafe Shutdowns: 0 00:19:51.684 Unrecoverable Media Errors: 0 00:19:51.684 Lifetime Error Log Entries: 0 00:19:51.684 Warning Temperature Time: 0 minutes 00:19:51.684 Critical Temperature Time: 0 minutes 00:19:51.684 00:19:51.684 Number of Queues 00:19:51.684 ================ 00:19:51.684 Number of I/O Submission Queues: 127 00:19:51.684 Number of I/O Completion Queues: 127 00:19:51.684 00:19:51.684 Active Namespaces 00:19:51.684 ================= 00:19:51.684 Namespace ID:1 00:19:51.684 Error Recovery Timeout: Unlimited 00:19:51.684 Command Set Identifier: NVM (00h) 00:19:51.684 Deallocate: Supported 00:19:51.684 Deallocated/Unwritten Error: Not Supported 00:19:51.684 Deallocated Read Value: Unknown 00:19:51.684 Deallocate in Write Zeroes: Not Supported 00:19:51.684 Deallocated Guard Field: 0xFFFF 00:19:51.684 Flush: Supported 00:19:51.684 Reservation: Supported 00:19:51.684 Namespace Sharing Capabilities: Multiple Controllers 00:19:51.685 Size (in LBAs): 131072 (0GiB) 00:19:51.685 Capacity (in LBAs): 131072 (0GiB) 00:19:51.685 Utilization (in LBAs): 131072 (0GiB) 00:19:51.685 NGUID: ABCDEF0123456789ABCDEF0123456789 00:19:51.685 EUI64: ABCDEF0123456789 00:19:51.685 UUID: 095215b9-23d9-4c18-9476-17b0b661c12d 00:19:51.685 Thin Provisioning: Not Supported 00:19:51.685 Per-NS Atomic Units: Yes 00:19:51.685 Atomic Boundary Size (Normal): 0 00:19:51.685 Atomic Boundary Size (PFail): 0 00:19:51.685 Atomic Boundary Offset: 0 00:19:51.685 Maximum Single Source Range Length: 65535 00:19:51.685 Maximum Copy Length: 65535 00:19:51.685 Maximum Source Range Count: 1 00:19:51.685 NGUID/EUI64 Never Reused: No 00:19:51.685 Namespace Write Protected: No 00:19:51.685 Number of LBA Formats: 1 00:19:51.685 Current LBA Format: LBA Format #00 00:19:51.685 LBA Format #00: Data Size: 512 Metadata Size: 0 00:19:51.685 00:19:51.685 18:08:00 -- host/identify.sh@51 -- # sync 00:19:51.685 18:08:00 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:51.685 18:08:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:19:51.685 18:08:00 -- common/autotest_common.sh@10 -- # set +x 00:19:51.685 18:08:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:19:51.685 18:08:00 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:19:51.685 18:08:00 -- host/identify.sh@56 -- # nvmftestfini 00:19:51.685 18:08:00 -- nvmf/common.sh@477 -- # nvmfcleanup 00:19:51.685 18:08:00 -- nvmf/common.sh@117 -- # sync 00:19:51.945 18:08:00 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:19:51.945 18:08:00 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:19:51.945 18:08:00 -- nvmf/common.sh@120 -- # set +e 00:19:51.945 18:08:00 -- nvmf/common.sh@121 -- # for i in {1..20} 00:19:51.945 18:08:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:19:51.945 rmmod nvme_rdma 00:19:51.945 rmmod nvme_fabrics 00:19:51.945 18:08:00 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:19:51.945 18:08:00 -- nvmf/common.sh@124 -- # set -e 00:19:51.945 18:08:00 -- nvmf/common.sh@125 -- # return 0 00:19:51.945 18:08:00 -- nvmf/common.sh@478 -- # '[' -n 1017714 ']' 00:19:51.945 18:08:00 -- nvmf/common.sh@479 -- # killprocess 1017714 00:19:51.945 18:08:00 -- common/autotest_common.sh@946 -- # '[' -z 1017714 ']' 00:19:51.945 18:08:00 -- common/autotest_common.sh@950 -- # kill -0 1017714 00:19:51.945 18:08:00 -- common/autotest_common.sh@951 -- # uname 00:19:51.945 18:08:00 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:19:51.945 18:08:00 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1017714 00:19:51.945 18:08:00 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:19:51.945 18:08:00 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:19:51.945 18:08:00 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1017714' 00:19:51.945 killing process with pid 1017714 00:19:51.945 18:08:00 -- common/autotest_common.sh@965 -- # kill 1017714 00:19:51.945 [2024-04-26 18:08:00.957055] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:19:51.945 18:08:00 -- common/autotest_common.sh@970 -- # wait 1017714 00:19:51.945 [2024-04-26 18:08:01.044509] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:19:52.205 18:08:01 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:19:52.205 18:08:01 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:19:52.205 00:19:52.205 real 0m8.320s 00:19:52.205 user 0m8.551s 00:19:52.205 sys 0m5.271s 00:19:52.205 18:08:01 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:19:52.205 18:08:01 -- common/autotest_common.sh@10 -- # set +x 00:19:52.205 ************************************ 00:19:52.205 END TEST nvmf_identify 00:19:52.205 ************************************ 00:19:52.205 18:08:01 -- nvmf/nvmf.sh@96 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:19:52.205 18:08:01 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:19:52.205 18:08:01 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:19:52.205 18:08:01 -- common/autotest_common.sh@10 -- # set +x 00:19:52.465 ************************************ 00:19:52.465 START TEST nvmf_perf 00:19:52.465 ************************************ 00:19:52.465 18:08:01 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=rdma 00:19:52.465 * Looking for test storage... 00:19:52.465 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:19:52.465 18:08:01 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:19:52.465 18:08:01 -- nvmf/common.sh@7 -- # uname -s 00:19:52.465 18:08:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:52.465 18:08:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:52.465 18:08:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:52.465 18:08:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:52.465 18:08:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:52.465 18:08:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:52.465 18:08:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:52.465 18:08:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:52.465 18:08:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:52.465 18:08:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:52.465 18:08:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:19:52.465 18:08:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:19:52.465 18:08:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:52.465 18:08:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:52.465 18:08:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:52.465 18:08:01 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:19:52.465 18:08:01 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:19:52.465 18:08:01 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:52.465 18:08:01 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:52.465 18:08:01 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:52.465 18:08:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.465 18:08:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.465 18:08:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.465 18:08:01 -- paths/export.sh@5 -- # export PATH 00:19:52.465 18:08:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:52.465 18:08:01 -- nvmf/common.sh@47 -- # : 0 00:19:52.465 18:08:01 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:19:52.465 18:08:01 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:19:52.465 18:08:01 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:19:52.465 18:08:01 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:52.465 18:08:01 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:52.465 18:08:01 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:19:52.465 18:08:01 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:19:52.465 18:08:01 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:19:52.465 18:08:01 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:19:52.465 18:08:01 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:19:52.465 18:08:01 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:19:52.465 18:08:01 -- host/perf.sh@17 -- # nvmftestinit 00:19:52.465 18:08:01 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:19:52.465 18:08:01 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:52.465 18:08:01 -- nvmf/common.sh@437 -- # prepare_net_devs 00:19:52.465 18:08:01 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:19:52.465 18:08:01 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:19:52.465 18:08:01 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:52.465 18:08:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:52.465 18:08:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.465 18:08:01 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:19:52.465 18:08:01 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:19:52.465 18:08:01 -- nvmf/common.sh@285 -- # xtrace_disable 00:19:52.465 18:08:01 -- common/autotest_common.sh@10 -- # set +x 00:19:59.037 18:08:07 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:59.037 18:08:07 -- nvmf/common.sh@291 -- # pci_devs=() 00:19:59.037 18:08:07 -- nvmf/common.sh@291 -- # local -a pci_devs 00:19:59.037 18:08:07 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:19:59.037 18:08:07 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:19:59.037 18:08:07 -- nvmf/common.sh@293 -- # pci_drivers=() 00:19:59.037 18:08:07 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:19:59.037 18:08:07 -- nvmf/common.sh@295 -- # net_devs=() 00:19:59.037 18:08:07 -- nvmf/common.sh@295 -- # local -ga net_devs 00:19:59.037 18:08:07 -- nvmf/common.sh@296 -- # e810=() 00:19:59.037 18:08:07 -- nvmf/common.sh@296 -- # local -ga e810 00:19:59.037 18:08:07 -- nvmf/common.sh@297 -- # x722=() 00:19:59.037 18:08:07 -- nvmf/common.sh@297 -- # local -ga x722 00:19:59.037 18:08:07 -- nvmf/common.sh@298 -- # mlx=() 00:19:59.037 18:08:07 -- nvmf/common.sh@298 -- # local -ga mlx 00:19:59.037 18:08:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:59.037 18:08:07 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:19:59.037 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:19:59.037 18:08:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:59.037 18:08:07 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:19:59.037 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:19:59.037 18:08:07 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:19:59.037 18:08:07 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.037 18:08:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.037 18:08:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:19:59.037 Found net devices under 0000:18:00.0: mlx_0_0 00:19:59.037 18:08:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:59.037 18:08:07 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:59.037 18:08:07 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:19:59.037 Found net devices under 0000:18:00.1: mlx_0_1 00:19:59.037 18:08:07 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:19:59.037 18:08:07 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@403 -- # is_hw=yes 00:19:59.037 18:08:07 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@409 -- # rdma_device_init 00:19:59.037 18:08:07 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:19:59.037 18:08:07 -- nvmf/common.sh@58 -- # uname 00:19:59.037 18:08:07 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:19:59.037 18:08:07 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:19:59.037 18:08:07 -- nvmf/common.sh@63 -- # modprobe ib_core 00:19:59.037 18:08:07 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:19:59.037 18:08:07 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:19:59.037 18:08:07 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:19:59.037 18:08:07 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:19:59.037 18:08:07 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:19:59.037 18:08:07 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:19:59.037 18:08:07 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:19:59.037 18:08:07 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:19:59.037 18:08:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:59.037 18:08:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:59.037 18:08:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:59.037 18:08:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:59.037 18:08:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:59.037 18:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:59.037 18:08:07 -- nvmf/common.sh@105 -- # continue 2 00:19:59.037 18:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.037 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:59.037 18:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:59.037 18:08:07 -- nvmf/common.sh@105 -- # continue 2 00:19:59.037 18:08:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:59.037 18:08:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:19:59.037 18:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:59.037 18:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:59.038 18:08:07 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:19:59.038 18:08:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:19:59.038 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:59.038 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:19:59.038 altname enp24s0f0np0 00:19:59.038 altname ens785f0np0 00:19:59.038 inet 192.168.100.8/24 scope global mlx_0_0 00:19:59.038 valid_lft forever preferred_lft forever 00:19:59.038 18:08:07 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:19:59.038 18:08:07 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:59.038 18:08:07 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:19:59.038 18:08:07 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:19:59.038 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:19:59.038 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:19:59.038 altname enp24s0f1np1 00:19:59.038 altname ens785f1np1 00:19:59.038 inet 192.168.100.9/24 scope global mlx_0_1 00:19:59.038 valid_lft forever preferred_lft forever 00:19:59.038 18:08:07 -- nvmf/common.sh@411 -- # return 0 00:19:59.038 18:08:07 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:19:59.038 18:08:07 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:19:59.038 18:08:07 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:19:59.038 18:08:07 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:19:59.038 18:08:07 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:19:59.038 18:08:07 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:19:59.038 18:08:07 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:19:59.038 18:08:07 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:19:59.038 18:08:07 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:19:59.038 18:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:59.038 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.038 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:19:59.038 18:08:07 -- nvmf/common.sh@105 -- # continue 2 00:19:59.038 18:08:07 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:19:59.038 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.038 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:19:59.038 18:08:07 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:19:59.038 18:08:07 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@105 -- # continue 2 00:19:59.038 18:08:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:59.038 18:08:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:19:59.038 18:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:59.038 18:08:07 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:19:59.038 18:08:07 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:19:59.038 18:08:07 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:19:59.038 18:08:07 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:19:59.038 192.168.100.9' 00:19:59.038 18:08:07 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:19:59.038 192.168.100.9' 00:19:59.038 18:08:07 -- nvmf/common.sh@446 -- # head -n 1 00:19:59.038 18:08:07 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:19:59.038 18:08:07 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:19:59.038 192.168.100.9' 00:19:59.038 18:08:07 -- nvmf/common.sh@447 -- # tail -n +2 00:19:59.038 18:08:07 -- nvmf/common.sh@447 -- # head -n 1 00:19:59.038 18:08:07 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:19:59.038 18:08:07 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:19:59.038 18:08:07 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:19:59.038 18:08:07 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:19:59.038 18:08:07 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:19:59.038 18:08:07 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:19:59.038 18:08:07 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:19:59.038 18:08:07 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:19:59.038 18:08:07 -- common/autotest_common.sh@720 -- # xtrace_disable 00:19:59.038 18:08:07 -- common/autotest_common.sh@10 -- # set +x 00:19:59.038 18:08:07 -- nvmf/common.sh@470 -- # nvmfpid=1020747 00:19:59.038 18:08:07 -- nvmf/common.sh@471 -- # waitforlisten 1020747 00:19:59.038 18:08:07 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:59.038 18:08:07 -- common/autotest_common.sh@827 -- # '[' -z 1020747 ']' 00:19:59.038 18:08:07 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:59.038 18:08:07 -- common/autotest_common.sh@832 -- # local max_retries=100 00:19:59.038 18:08:07 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:59.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:59.038 18:08:07 -- common/autotest_common.sh@836 -- # xtrace_disable 00:19:59.038 18:08:07 -- common/autotest_common.sh@10 -- # set +x 00:19:59.038 [2024-04-26 18:08:07.447944] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:19:59.038 [2024-04-26 18:08:07.448007] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:59.038 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.038 [2024-04-26 18:08:07.520548] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:59.038 [2024-04-26 18:08:07.603670] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:59.038 [2024-04-26 18:08:07.603709] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:59.038 [2024-04-26 18:08:07.603720] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:19:59.038 [2024-04-26 18:08:07.603745] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:19:59.038 [2024-04-26 18:08:07.603752] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:59.038 [2024-04-26 18:08:07.603797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:59.038 [2024-04-26 18:08:07.603882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:59.038 [2024-04-26 18:08:07.603959] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:59.038 [2024-04-26 18:08:07.603961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:59.297 18:08:08 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:19:59.297 18:08:08 -- common/autotest_common.sh@860 -- # return 0 00:19:59.297 18:08:08 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:19:59.297 18:08:08 -- common/autotest_common.sh@726 -- # xtrace_disable 00:19:59.297 18:08:08 -- common/autotest_common.sh@10 -- # set +x 00:19:59.297 18:08:08 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:59.297 18:08:08 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/gen_nvme.sh 00:19:59.297 18:08:08 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:20:02.586 18:08:11 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:20:02.586 18:08:11 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:20:02.587 18:08:11 -- host/perf.sh@30 -- # local_nvme_trid=0000:5f:00.0 00:20:02.587 18:08:11 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:20:02.587 18:08:11 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:20:02.587 18:08:11 -- host/perf.sh@33 -- # '[' -n 0000:5f:00.0 ']' 00:20:02.587 18:08:11 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:20:02.587 18:08:11 -- host/perf.sh@37 -- # '[' rdma == rdma ']' 00:20:02.587 18:08:11 -- host/perf.sh@40 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -c 0 00:20:02.846 [2024-04-26 18:08:11.919296] rdma.c:2712:nvmf_rdma_create: *WARNING*: In capsule data size is set to 256, this is minimum size required to support msdbd=16 00:20:02.846 [2024-04-26 18:08:11.940777] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1dc5870/0x1df3580) succeed. 00:20:02.846 [2024-04-26 18:08:11.951647] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1dc6eb0/0x1e53540) succeed. 00:20:03.105 18:08:12 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:03.105 18:08:12 -- host/perf.sh@45 -- # for bdev in $bdevs 00:20:03.105 18:08:12 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:03.363 18:08:12 -- host/perf.sh@45 -- # for bdev in $bdevs 00:20:03.363 18:08:12 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:20:03.622 18:08:12 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:03.622 [2024-04-26 18:08:12.793443] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:03.881 18:08:12 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:20:03.881 18:08:13 -- host/perf.sh@52 -- # '[' -n 0000:5f:00.0 ']' 00:20:03.881 18:08:13 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:20:03.881 18:08:13 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:20:03.881 18:08:13 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5f:00.0' 00:20:05.255 Initializing NVMe Controllers 00:20:05.255 Attached to NVMe Controller at 0000:5f:00.0 [8086:0a54] 00:20:05.255 Associating PCIE (0000:5f:00.0) NSID 1 with lcore 0 00:20:05.255 Initialization complete. Launching workers. 00:20:05.255 ======================================================== 00:20:05.255 Latency(us) 00:20:05.255 Device Information : IOPS MiB/s Average min max 00:20:05.255 PCIE (0000:5f:00.0) NSID 1 from core 0: 99154.54 387.32 322.30 14.10 4437.60 00:20:05.255 ======================================================== 00:20:05.255 Total : 99154.54 387.32 322.30 14.10 4437.60 00:20:05.255 00:20:05.255 18:08:14 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:20:05.255 EAL: No free 2048 kB hugepages reported on node 1 00:20:08.539 Initializing NVMe Controllers 00:20:08.539 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:08.539 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:08.539 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:08.539 Initialization complete. Launching workers. 00:20:08.539 ======================================================== 00:20:08.539 Latency(us) 00:20:08.539 Device Information : IOPS MiB/s Average min max 00:20:08.539 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 6815.99 26.62 145.92 49.84 4087.47 00:20:08.539 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 5278.99 20.62 188.47 67.67 4113.41 00:20:08.539 ======================================================== 00:20:08.539 Total : 12094.99 47.25 164.49 49.84 4113.41 00:20:08.539 00:20:08.539 18:08:17 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:20:08.539 EAL: No free 2048 kB hugepages reported on node 1 00:20:12.732 Initializing NVMe Controllers 00:20:12.732 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:12.732 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:12.732 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:12.732 Initialization complete. Launching workers. 00:20:12.732 ======================================================== 00:20:12.732 Latency(us) 00:20:12.732 Device Information : IOPS MiB/s Average min max 00:20:12.732 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 18464.30 72.13 1733.13 487.53 5800.25 00:20:12.732 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4031.85 15.75 7979.01 6943.65 9011.71 00:20:12.732 ======================================================== 00:20:12.732 Total : 22496.15 87.88 2852.54 487.53 9011.71 00:20:12.732 00:20:12.732 18:08:21 -- host/perf.sh@59 -- # [[ mlx5 == \e\8\1\0 ]] 00:20:12.732 18:08:21 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:20:12.732 EAL: No free 2048 kB hugepages reported on node 1 00:20:16.929 Initializing NVMe Controllers 00:20:16.929 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:16.929 Controller IO queue size 128, less than required. 00:20:16.929 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:16.929 Controller IO queue size 128, less than required. 00:20:16.929 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:16.929 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:16.929 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:16.929 Initialization complete. Launching workers. 00:20:16.929 ======================================================== 00:20:16.929 Latency(us) 00:20:16.929 Device Information : IOPS MiB/s Average min max 00:20:16.929 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 3420.42 855.11 37580.82 16114.48 90703.76 00:20:16.929 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3625.89 906.47 34970.09 15457.58 55787.38 00:20:16.929 ======================================================== 00:20:16.929 Total : 7046.31 1761.58 36237.39 15457.58 90703.76 00:20:16.929 00:20:16.929 18:08:25 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' -c 0xf -P 4 00:20:16.929 EAL: No free 2048 kB hugepages reported on node 1 00:20:16.929 No valid NVMe controllers or AIO or URING devices found 00:20:16.929 Initializing NVMe Controllers 00:20:16.929 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:16.929 Controller IO queue size 128, less than required. 00:20:16.929 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:16.930 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:20:16.930 Controller IO queue size 128, less than required. 00:20:16.930 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:16.930 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:20:16.930 WARNING: Some requested NVMe devices were skipped 00:20:16.930 18:08:25 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' --transport-stat 00:20:16.930 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.187 Initializing NVMe Controllers 00:20:21.187 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:20:21.187 Controller IO queue size 128, less than required. 00:20:21.187 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:21.187 Controller IO queue size 128, less than required. 00:20:21.187 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:20:21.187 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:21.187 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:20:21.187 Initialization complete. Launching workers. 00:20:21.187 00:20:21.187 ==================== 00:20:21.187 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:20:21.187 RDMA transport: 00:20:21.187 dev name: mlx5_0 00:20:21.187 polls: 397871 00:20:21.187 idle_polls: 394462 00:20:21.187 completions: 42402 00:20:21.187 queued_requests: 1 00:20:21.187 total_send_wrs: 21201 00:20:21.187 send_doorbell_updates: 3131 00:20:21.187 total_recv_wrs: 21328 00:20:21.187 recv_doorbell_updates: 3140 00:20:21.187 --------------------------------- 00:20:21.187 00:20:21.187 ==================== 00:20:21.187 lcore 0, ns RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:20:21.187 RDMA transport: 00:20:21.187 dev name: mlx5_0 00:20:21.187 polls: 405168 00:20:21.187 idle_polls: 404902 00:20:21.187 completions: 19894 00:20:21.187 queued_requests: 1 00:20:21.187 total_send_wrs: 9947 00:20:21.187 send_doorbell_updates: 253 00:20:21.187 total_recv_wrs: 10074 00:20:21.187 recv_doorbell_updates: 254 00:20:21.187 --------------------------------- 00:20:21.187 ======================================================== 00:20:21.187 Latency(us) 00:20:21.187 Device Information : IOPS MiB/s Average min max 00:20:21.187 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 5293.65 1323.41 24178.75 11621.79 57739.10 00:20:21.187 RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 2483.52 620.88 51806.62 31645.21 79672.99 00:20:21.187 ======================================================== 00:20:21.187 Total : 7777.17 1944.29 33001.29 11621.79 79672.99 00:20:21.187 00:20:21.187 18:08:30 -- host/perf.sh@66 -- # sync 00:20:21.187 18:08:30 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:21.187 18:08:30 -- host/perf.sh@69 -- # '[' 0 -eq 1 ']' 00:20:21.187 18:08:30 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:20:21.187 18:08:30 -- host/perf.sh@114 -- # nvmftestfini 00:20:21.187 18:08:30 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:21.187 18:08:30 -- nvmf/common.sh@117 -- # sync 00:20:21.187 18:08:30 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:21.187 18:08:30 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:21.187 18:08:30 -- nvmf/common.sh@120 -- # set +e 00:20:21.187 18:08:30 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:21.187 18:08:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:21.187 rmmod nvme_rdma 00:20:21.187 rmmod nvme_fabrics 00:20:21.446 18:08:30 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:21.446 18:08:30 -- nvmf/common.sh@124 -- # set -e 00:20:21.446 18:08:30 -- nvmf/common.sh@125 -- # return 0 00:20:21.446 18:08:30 -- nvmf/common.sh@478 -- # '[' -n 1020747 ']' 00:20:21.446 18:08:30 -- nvmf/common.sh@479 -- # killprocess 1020747 00:20:21.447 18:08:30 -- common/autotest_common.sh@946 -- # '[' -z 1020747 ']' 00:20:21.447 18:08:30 -- common/autotest_common.sh@950 -- # kill -0 1020747 00:20:21.447 18:08:30 -- common/autotest_common.sh@951 -- # uname 00:20:21.447 18:08:30 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:20:21.447 18:08:30 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1020747 00:20:21.447 18:08:30 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:20:21.447 18:08:30 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:20:21.447 18:08:30 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1020747' 00:20:21.447 killing process with pid 1020747 00:20:21.447 18:08:30 -- common/autotest_common.sh@965 -- # kill 1020747 00:20:21.447 18:08:30 -- common/autotest_common.sh@970 -- # wait 1020747 00:20:21.447 [2024-04-26 18:08:30.507528] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:25.639 18:08:34 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:25.639 18:08:34 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:25.639 00:20:25.639 real 0m32.926s 00:20:25.639 user 1m49.139s 00:20:25.639 sys 0m5.678s 00:20:25.639 18:08:34 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:20:25.639 18:08:34 -- common/autotest_common.sh@10 -- # set +x 00:20:25.639 ************************************ 00:20:25.639 END TEST nvmf_perf 00:20:25.639 ************************************ 00:20:25.639 18:08:34 -- nvmf/nvmf.sh@97 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:20:25.639 18:08:34 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:20:25.639 18:08:34 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:20:25.639 18:08:34 -- common/autotest_common.sh@10 -- # set +x 00:20:25.639 ************************************ 00:20:25.639 START TEST nvmf_fio_host 00:20:25.639 ************************************ 00:20:25.639 18:08:34 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=rdma 00:20:25.639 * Looking for test storage... 00:20:25.639 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:25.639 18:08:34 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:25.639 18:08:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:25.639 18:08:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:25.639 18:08:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:25.639 18:08:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@5 -- # export PATH 00:20:25.639 18:08:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:25.639 18:08:34 -- nvmf/common.sh@7 -- # uname -s 00:20:25.639 18:08:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:25.639 18:08:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:25.639 18:08:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:25.639 18:08:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:25.639 18:08:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:25.639 18:08:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:25.639 18:08:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:25.639 18:08:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:25.639 18:08:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:25.639 18:08:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:25.639 18:08:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:25.639 18:08:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:25.639 18:08:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:25.639 18:08:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:25.639 18:08:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:25.639 18:08:34 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:25.639 18:08:34 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:25.639 18:08:34 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:25.639 18:08:34 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:25.639 18:08:34 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:25.639 18:08:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- paths/export.sh@5 -- # export PATH 00:20:25.639 18:08:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:25.639 18:08:34 -- nvmf/common.sh@47 -- # : 0 00:20:25.639 18:08:34 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:25.639 18:08:34 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:25.639 18:08:34 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:25.639 18:08:34 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:25.639 18:08:34 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:25.639 18:08:34 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:25.639 18:08:34 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:25.639 18:08:34 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:25.639 18:08:34 -- host/fio.sh@12 -- # nvmftestinit 00:20:25.639 18:08:34 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:25.640 18:08:34 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:25.640 18:08:34 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:25.640 18:08:34 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:25.640 18:08:34 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:25.640 18:08:34 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:25.640 18:08:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:25.640 18:08:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:25.640 18:08:34 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:25.640 18:08:34 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:25.640 18:08:34 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:25.640 18:08:34 -- common/autotest_common.sh@10 -- # set +x 00:20:32.206 18:08:40 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:32.206 18:08:40 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:32.206 18:08:40 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:32.206 18:08:40 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:32.206 18:08:40 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:32.206 18:08:40 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:32.206 18:08:40 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:32.206 18:08:40 -- nvmf/common.sh@295 -- # net_devs=() 00:20:32.206 18:08:40 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:32.206 18:08:40 -- nvmf/common.sh@296 -- # e810=() 00:20:32.206 18:08:40 -- nvmf/common.sh@296 -- # local -ga e810 00:20:32.206 18:08:40 -- nvmf/common.sh@297 -- # x722=() 00:20:32.206 18:08:40 -- nvmf/common.sh@297 -- # local -ga x722 00:20:32.206 18:08:40 -- nvmf/common.sh@298 -- # mlx=() 00:20:32.206 18:08:40 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:32.206 18:08:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:32.206 18:08:40 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:32.206 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:32.206 18:08:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:32.206 18:08:40 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:32.206 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:32.206 18:08:40 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:32.206 18:08:40 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:32.206 18:08:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:32.206 18:08:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:32.206 Found net devices under 0000:18:00.0: mlx_0_0 00:20:32.206 18:08:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:32.206 18:08:40 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:32.206 18:08:40 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:32.206 Found net devices under 0000:18:00.1: mlx_0_1 00:20:32.206 18:08:40 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:32.206 18:08:40 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:32.206 18:08:40 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:32.206 18:08:40 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:32.206 18:08:40 -- nvmf/common.sh@58 -- # uname 00:20:32.206 18:08:40 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:32.206 18:08:40 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:32.206 18:08:40 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:32.206 18:08:40 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:32.206 18:08:40 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:32.206 18:08:40 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:32.206 18:08:40 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:32.206 18:08:40 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:32.206 18:08:40 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:32.206 18:08:40 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:32.206 18:08:40 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:32.206 18:08:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:32.206 18:08:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:32.206 18:08:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:32.206 18:08:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:32.206 18:08:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:32.206 18:08:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:32.206 18:08:40 -- nvmf/common.sh@105 -- # continue 2 00:20:32.206 18:08:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.206 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:32.206 18:08:40 -- nvmf/common.sh@105 -- # continue 2 00:20:32.206 18:08:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:32.206 18:08:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:32.206 18:08:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:32.206 18:08:40 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:32.206 18:08:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:32.206 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:32.206 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:32.206 altname enp24s0f0np0 00:20:32.206 altname ens785f0np0 00:20:32.206 inet 192.168.100.8/24 scope global mlx_0_0 00:20:32.206 valid_lft forever preferred_lft forever 00:20:32.206 18:08:40 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:32.206 18:08:40 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:32.206 18:08:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:32.206 18:08:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:32.206 18:08:40 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:32.206 18:08:40 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:32.206 18:08:40 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:32.206 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:32.207 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:32.207 altname enp24s0f1np1 00:20:32.207 altname ens785f1np1 00:20:32.207 inet 192.168.100.9/24 scope global mlx_0_1 00:20:32.207 valid_lft forever preferred_lft forever 00:20:32.207 18:08:40 -- nvmf/common.sh@411 -- # return 0 00:20:32.207 18:08:40 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:32.207 18:08:40 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:32.207 18:08:40 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:32.207 18:08:40 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:32.207 18:08:40 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:32.207 18:08:40 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:32.207 18:08:40 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:32.207 18:08:40 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:32.207 18:08:40 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:32.207 18:08:40 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:32.207 18:08:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:32.207 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.207 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:32.207 18:08:40 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:32.207 18:08:40 -- nvmf/common.sh@105 -- # continue 2 00:20:32.207 18:08:40 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:32.207 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.207 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:32.207 18:08:40 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:32.207 18:08:40 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:32.207 18:08:40 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:32.207 18:08:40 -- nvmf/common.sh@105 -- # continue 2 00:20:32.207 18:08:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:32.207 18:08:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:32.207 18:08:40 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:32.207 18:08:40 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:32.207 18:08:40 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:32.207 18:08:40 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:32.207 18:08:40 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:32.207 18:08:40 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:32.207 192.168.100.9' 00:20:32.207 18:08:40 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:32.207 192.168.100.9' 00:20:32.207 18:08:40 -- nvmf/common.sh@446 -- # head -n 1 00:20:32.207 18:08:40 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:32.207 18:08:40 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:32.207 192.168.100.9' 00:20:32.207 18:08:40 -- nvmf/common.sh@447 -- # tail -n +2 00:20:32.207 18:08:40 -- nvmf/common.sh@447 -- # head -n 1 00:20:32.207 18:08:40 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:32.207 18:08:40 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:32.207 18:08:40 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:32.207 18:08:40 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:32.207 18:08:40 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:32.207 18:08:40 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:32.207 18:08:40 -- host/fio.sh@14 -- # [[ y != y ]] 00:20:32.207 18:08:40 -- host/fio.sh@19 -- # timing_enter start_nvmf_tgt 00:20:32.207 18:08:40 -- common/autotest_common.sh@720 -- # xtrace_disable 00:20:32.207 18:08:40 -- common/autotest_common.sh@10 -- # set +x 00:20:32.207 18:08:40 -- host/fio.sh@22 -- # nvmfpid=1027062 00:20:32.207 18:08:40 -- host/fio.sh@24 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:32.207 18:08:40 -- host/fio.sh@26 -- # waitforlisten 1027062 00:20:32.207 18:08:40 -- common/autotest_common.sh@827 -- # '[' -z 1027062 ']' 00:20:32.207 18:08:40 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:32.207 18:08:40 -- common/autotest_common.sh@832 -- # local max_retries=100 00:20:32.207 18:08:40 -- host/fio.sh@21 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:32.207 18:08:40 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:32.207 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:32.207 18:08:40 -- common/autotest_common.sh@836 -- # xtrace_disable 00:20:32.207 18:08:40 -- common/autotest_common.sh@10 -- # set +x 00:20:32.207 [2024-04-26 18:08:40.592832] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:20:32.207 [2024-04-26 18:08:40.592893] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:32.207 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.207 [2024-04-26 18:08:40.669782] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:32.207 [2024-04-26 18:08:40.762750] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:32.207 [2024-04-26 18:08:40.762794] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:32.207 [2024-04-26 18:08:40.762804] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:32.207 [2024-04-26 18:08:40.762813] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:32.207 [2024-04-26 18:08:40.762820] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:32.207 [2024-04-26 18:08:40.762881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:32.207 [2024-04-26 18:08:40.762979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:32.207 [2024-04-26 18:08:40.763057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:32.207 [2024-04-26 18:08:40.763059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:32.466 18:08:41 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:20:32.466 18:08:41 -- common/autotest_common.sh@860 -- # return 0 00:20:32.466 18:08:41 -- host/fio.sh@27 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:32.466 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.466 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.466 [2024-04-26 18:08:41.425950] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1bdb4d0/0x1bdf9c0) succeed. 00:20:32.466 [2024-04-26 18:08:41.436558] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1bdcb10/0x1c21050) succeed. 00:20:32.466 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.466 18:08:41 -- host/fio.sh@28 -- # timing_exit start_nvmf_tgt 00:20:32.466 18:08:41 -- common/autotest_common.sh@726 -- # xtrace_disable 00:20:32.466 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.466 18:08:41 -- host/fio.sh@30 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:32.466 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.466 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.466 Malloc1 00:20:32.466 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.466 18:08:41 -- host/fio.sh@31 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:32.466 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.466 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.466 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.466 18:08:41 -- host/fio.sh@32 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:32.466 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.466 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.732 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.732 18:08:41 -- host/fio.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:32.732 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.732 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.732 [2024-04-26 18:08:41.671236] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:32.732 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.732 18:08:41 -- host/fio.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:20:32.732 18:08:41 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:32.732 18:08:41 -- common/autotest_common.sh@10 -- # set +x 00:20:32.732 18:08:41 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:32.732 18:08:41 -- host/fio.sh@36 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:20:32.733 18:08:41 -- host/fio.sh@39 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:32.733 18:08:41 -- common/autotest_common.sh@1356 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:32.733 18:08:41 -- common/autotest_common.sh@1333 -- # local fio_dir=/usr/src/fio 00:20:32.733 18:08:41 -- common/autotest_common.sh@1335 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:20:32.733 18:08:41 -- common/autotest_common.sh@1335 -- # local sanitizers 00:20:32.733 18:08:41 -- common/autotest_common.sh@1336 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:32.733 18:08:41 -- common/autotest_common.sh@1337 -- # shift 00:20:32.733 18:08:41 -- common/autotest_common.sh@1339 -- # local asan_lib= 00:20:32.733 18:08:41 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # grep libasan 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # asan_lib= 00:20:32.733 18:08:41 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:20:32.733 18:08:41 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # grep libclang_rt.asan 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:20:32.733 18:08:41 -- common/autotest_common.sh@1341 -- # asan_lib= 00:20:32.733 18:08:41 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:20:32.733 18:08:41 -- common/autotest_common.sh@1348 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:20:32.733 18:08:41 -- common/autotest_common.sh@1348 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' --bs=4096 00:20:32.992 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:20:32.992 fio-3.35 00:20:32.992 Starting 1 thread 00:20:32.992 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.528 00:20:35.529 test: (groupid=0, jobs=1): err= 0: pid=1027489: Fri Apr 26 18:08:44 2024 00:20:35.529 read: IOPS=17.8k, BW=69.4MiB/s (72.8MB/s)(139MiB/2004msec) 00:20:35.529 slat (nsec): min=1388, max=33198, avg=1555.77, stdev=472.17 00:20:35.529 clat (usec): min=2074, max=6460, avg=3577.38, stdev=89.12 00:20:35.529 lat (usec): min=2106, max=6462, avg=3578.94, stdev=89.06 00:20:35.529 clat percentiles (usec): 00:20:35.529 | 1.00th=[ 3490], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3556], 00:20:35.529 | 30.00th=[ 3556], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 3589], 00:20:35.529 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3589], 95.00th=[ 3621], 00:20:35.529 | 99.00th=[ 3654], 99.50th=[ 3916], 99.90th=[ 4686], 99.95th=[ 5604], 00:20:35.529 | 99.99th=[ 6456] 00:20:35.529 bw ( KiB/s): min=69744, max=71696, per=100.00%, avg=71078.00, stdev=900.36, samples=4 00:20:35.529 iops : min=17436, max=17924, avg=17769.50, stdev=225.09, samples=4 00:20:35.529 write: IOPS=17.8k, BW=69.4MiB/s (72.8MB/s)(139MiB/2004msec); 0 zone resets 00:20:35.529 slat (nsec): min=1448, max=29000, avg=1879.62, stdev=534.34 00:20:35.529 clat (usec): min=2119, max=6481, avg=3576.10, stdev=88.02 00:20:35.529 lat (usec): min=2130, max=6482, avg=3577.98, stdev=87.96 00:20:35.529 clat percentiles (usec): 00:20:35.529 | 1.00th=[ 3523], 5.00th=[ 3556], 10.00th=[ 3556], 20.00th=[ 3556], 00:20:35.529 | 30.00th=[ 3556], 40.00th=[ 3556], 50.00th=[ 3589], 60.00th=[ 3589], 00:20:35.529 | 70.00th=[ 3589], 80.00th=[ 3589], 90.00th=[ 3589], 95.00th=[ 3589], 00:20:35.529 | 99.00th=[ 3654], 99.50th=[ 3916], 99.90th=[ 4686], 99.95th=[ 5604], 00:20:35.529 | 99.99th=[ 6456] 00:20:35.529 bw ( KiB/s): min=69736, max=71704, per=100.00%, avg=71088.00, stdev=909.73, samples=4 00:20:35.529 iops : min=17434, max=17926, avg=17772.00, stdev=227.43, samples=4 00:20:35.529 lat (msec) : 4=99.83%, 10=0.17% 00:20:35.529 cpu : usr=99.60%, sys=0.00%, ctx=14, majf=0, minf=3 00:20:35.529 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:20:35.529 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:35.529 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:35.529 issued rwts: total=35605,35605,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:35.529 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:35.529 00:20:35.529 Run status group 0 (all jobs): 00:20:35.529 READ: bw=69.4MiB/s (72.8MB/s), 69.4MiB/s-69.4MiB/s (72.8MB/s-72.8MB/s), io=139MiB (146MB), run=2004-2004msec 00:20:35.529 WRITE: bw=69.4MiB/s (72.8MB/s), 69.4MiB/s-69.4MiB/s (72.8MB/s-72.8MB/s), io=139MiB (146MB), run=2004-2004msec 00:20:35.529 18:08:44 -- host/fio.sh@43 -- # fio_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:35.529 18:08:44 -- common/autotest_common.sh@1356 -- # fio_plugin /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:35.529 18:08:44 -- common/autotest_common.sh@1333 -- # local fio_dir=/usr/src/fio 00:20:35.529 18:08:44 -- common/autotest_common.sh@1335 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:20:35.529 18:08:44 -- common/autotest_common.sh@1335 -- # local sanitizers 00:20:35.529 18:08:44 -- common/autotest_common.sh@1336 -- # local plugin=/var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:35.529 18:08:44 -- common/autotest_common.sh@1337 -- # shift 00:20:35.529 18:08:44 -- common/autotest_common.sh@1339 -- # local asan_lib= 00:20:35.529 18:08:44 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # grep libasan 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # asan_lib= 00:20:35.529 18:08:44 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:20:35.529 18:08:44 -- common/autotest_common.sh@1340 -- # for sanitizer in "${sanitizers[@]}" 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # ldd /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # grep libclang_rt.asan 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # awk '{print $3}' 00:20:35.529 18:08:44 -- common/autotest_common.sh@1341 -- # asan_lib= 00:20:35.529 18:08:44 -- common/autotest_common.sh@1342 -- # [[ -n '' ]] 00:20:35.529 18:08:44 -- common/autotest_common.sh@1348 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/fio/spdk_nvme' 00:20:35.529 18:08:44 -- common/autotest_common.sh@1348 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=rdma adrfam=IPv4 traddr=192.168.100.8 trsvcid=4420 ns=1' 00:20:35.529 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:20:35.529 fio-3.35 00:20:35.529 Starting 1 thread 00:20:35.529 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.058 00:20:38.058 test: (groupid=0, jobs=1): err= 0: pid=1027900: Fri Apr 26 18:08:46 2024 00:20:38.058 read: IOPS=13.1k, BW=205MiB/s (215MB/s)(403MiB/1968msec) 00:20:38.058 slat (nsec): min=2301, max=42090, avg=2681.52, stdev=1415.45 00:20:38.058 clat (usec): min=306, max=9945, avg=1813.61, stdev=1201.76 00:20:38.058 lat (usec): min=308, max=9950, avg=1816.29, stdev=1202.45 00:20:38.058 clat percentiles (usec): 00:20:38.058 | 1.00th=[ 545], 5.00th=[ 783], 10.00th=[ 947], 20.00th=[ 1139], 00:20:38.058 | 30.00th=[ 1254], 40.00th=[ 1369], 50.00th=[ 1483], 60.00th=[ 1631], 00:20:38.058 | 70.00th=[ 1827], 80.00th=[ 2073], 90.00th=[ 2671], 95.00th=[ 4948], 00:20:38.058 | 99.00th=[ 6849], 99.50th=[ 7439], 99.90th=[ 9241], 99.95th=[ 9503], 00:20:38.058 | 99.99th=[ 9896] 00:20:38.058 bw ( KiB/s): min=100064, max=104992, per=48.78%, avg=102256.00, stdev=2265.38, samples=4 00:20:38.058 iops : min= 6254, max= 6562, avg=6391.00, stdev=141.59, samples=4 00:20:38.058 write: IOPS=7230, BW=113MiB/s (118MB/s)(208MiB/1839msec); 0 zone resets 00:20:38.058 slat (usec): min=27, max=118, avg=30.16, stdev= 7.09 00:20:38.058 clat (usec): min=4720, max=22003, avg=13944.38, stdev=1820.60 00:20:38.058 lat (usec): min=4747, max=22031, avg=13974.53, stdev=1820.22 00:20:38.058 clat percentiles (usec): 00:20:38.058 | 1.00th=[ 7242], 5.00th=[11600], 10.00th=[12125], 20.00th=[12649], 00:20:38.058 | 30.00th=[13042], 40.00th=[13435], 50.00th=[13829], 60.00th=[14222], 00:20:38.058 | 70.00th=[14746], 80.00th=[15270], 90.00th=[16057], 95.00th=[16909], 00:20:38.059 | 99.00th=[18744], 99.50th=[19268], 99.90th=[21103], 99.95th=[21365], 00:20:38.059 | 99.99th=[21627] 00:20:38.059 bw ( KiB/s): min=102688, max=108256, per=91.21%, avg=105520.00, stdev=2388.60, samples=4 00:20:38.059 iops : min= 6418, max= 6766, avg=6595.00, stdev=149.29, samples=4 00:20:38.059 lat (usec) : 500=0.43%, 750=2.48%, 1000=5.11% 00:20:38.059 lat (msec) : 2=43.00%, 4=10.34%, 10=5.13%, 20=33.39%, 50=0.13% 00:20:38.059 cpu : usr=96.66%, sys=1.65%, ctx=184, majf=0, minf=2 00:20:38.059 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.5% 00:20:38.059 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:38.059 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:20:38.059 issued rwts: total=25784,13297,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:38.059 latency : target=0, window=0, percentile=100.00%, depth=128 00:20:38.059 00:20:38.059 Run status group 0 (all jobs): 00:20:38.059 READ: bw=205MiB/s (215MB/s), 205MiB/s-205MiB/s (215MB/s-215MB/s), io=403MiB (422MB), run=1968-1968msec 00:20:38.059 WRITE: bw=113MiB/s (118MB/s), 113MiB/s-113MiB/s (118MB/s-118MB/s), io=208MiB (218MB), run=1839-1839msec 00:20:38.059 18:08:47 -- host/fio.sh@45 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:38.059 18:08:47 -- common/autotest_common.sh@559 -- # xtrace_disable 00:20:38.059 18:08:47 -- common/autotest_common.sh@10 -- # set +x 00:20:38.059 18:08:47 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:20:38.059 18:08:47 -- host/fio.sh@47 -- # '[' 0 -eq 1 ']' 00:20:38.059 18:08:47 -- host/fio.sh@81 -- # trap - SIGINT SIGTERM EXIT 00:20:38.059 18:08:47 -- host/fio.sh@83 -- # rm -f ./local-test-0-verify.state 00:20:38.059 18:08:47 -- host/fio.sh@84 -- # nvmftestfini 00:20:38.059 18:08:47 -- nvmf/common.sh@477 -- # nvmfcleanup 00:20:38.059 18:08:47 -- nvmf/common.sh@117 -- # sync 00:20:38.059 18:08:47 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:20:38.059 18:08:47 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:20:38.059 18:08:47 -- nvmf/common.sh@120 -- # set +e 00:20:38.059 18:08:47 -- nvmf/common.sh@121 -- # for i in {1..20} 00:20:38.059 18:08:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:20:38.059 rmmod nvme_rdma 00:20:38.059 rmmod nvme_fabrics 00:20:38.059 18:08:47 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:20:38.059 18:08:47 -- nvmf/common.sh@124 -- # set -e 00:20:38.059 18:08:47 -- nvmf/common.sh@125 -- # return 0 00:20:38.059 18:08:47 -- nvmf/common.sh@478 -- # '[' -n 1027062 ']' 00:20:38.059 18:08:47 -- nvmf/common.sh@479 -- # killprocess 1027062 00:20:38.059 18:08:47 -- common/autotest_common.sh@946 -- # '[' -z 1027062 ']' 00:20:38.059 18:08:47 -- common/autotest_common.sh@950 -- # kill -0 1027062 00:20:38.059 18:08:47 -- common/autotest_common.sh@951 -- # uname 00:20:38.059 18:08:47 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:20:38.059 18:08:47 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1027062 00:20:38.059 18:08:47 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:20:38.059 18:08:47 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:20:38.059 18:08:47 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1027062' 00:20:38.059 killing process with pid 1027062 00:20:38.059 18:08:47 -- common/autotest_common.sh@965 -- # kill 1027062 00:20:38.059 18:08:47 -- common/autotest_common.sh@970 -- # wait 1027062 00:20:38.059 [2024-04-26 18:08:47.205324] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:20:38.316 18:08:47 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:20:38.316 18:08:47 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:20:38.316 00:20:38.316 real 0m12.887s 00:20:38.316 user 0m37.942s 00:20:38.316 sys 0m5.243s 00:20:38.316 18:08:47 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:20:38.316 18:08:47 -- common/autotest_common.sh@10 -- # set +x 00:20:38.316 ************************************ 00:20:38.316 END TEST nvmf_fio_host 00:20:38.316 ************************************ 00:20:38.316 18:08:47 -- nvmf/nvmf.sh@98 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:20:38.316 18:08:47 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:20:38.316 18:08:47 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:20:38.316 18:08:47 -- common/autotest_common.sh@10 -- # set +x 00:20:38.574 ************************************ 00:20:38.574 START TEST nvmf_failover 00:20:38.574 ************************************ 00:20:38.574 18:08:47 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=rdma 00:20:38.574 * Looking for test storage... 00:20:38.574 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:20:38.832 18:08:47 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:20:38.832 18:08:47 -- nvmf/common.sh@7 -- # uname -s 00:20:38.832 18:08:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:38.832 18:08:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:38.832 18:08:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:38.832 18:08:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:38.832 18:08:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:38.832 18:08:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:38.832 18:08:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:38.832 18:08:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:38.832 18:08:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:38.832 18:08:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:38.832 18:08:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:20:38.832 18:08:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:20:38.832 18:08:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:38.832 18:08:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:38.832 18:08:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:38.832 18:08:47 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:20:38.832 18:08:47 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:20:38.832 18:08:47 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:38.832 18:08:47 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:38.832 18:08:47 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:38.832 18:08:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:38.833 18:08:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:38.833 18:08:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:38.833 18:08:47 -- paths/export.sh@5 -- # export PATH 00:20:38.833 18:08:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:38.833 18:08:47 -- nvmf/common.sh@47 -- # : 0 00:20:38.833 18:08:47 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:20:38.833 18:08:47 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:20:38.833 18:08:47 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:20:38.833 18:08:47 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:38.833 18:08:47 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:38.833 18:08:47 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:20:38.833 18:08:47 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:20:38.833 18:08:47 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:20:38.833 18:08:47 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:38.833 18:08:47 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:38.833 18:08:47 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py 00:20:38.833 18:08:47 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:38.833 18:08:47 -- host/failover.sh@18 -- # nvmftestinit 00:20:38.833 18:08:47 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:20:38.833 18:08:47 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:38.833 18:08:47 -- nvmf/common.sh@437 -- # prepare_net_devs 00:20:38.833 18:08:47 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:20:38.833 18:08:47 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:20:38.833 18:08:47 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:38.833 18:08:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:38.833 18:08:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:38.833 18:08:47 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:20:38.833 18:08:47 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:20:38.833 18:08:47 -- nvmf/common.sh@285 -- # xtrace_disable 00:20:38.833 18:08:47 -- common/autotest_common.sh@10 -- # set +x 00:20:45.416 18:08:53 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:45.416 18:08:53 -- nvmf/common.sh@291 -- # pci_devs=() 00:20:45.416 18:08:53 -- nvmf/common.sh@291 -- # local -a pci_devs 00:20:45.416 18:08:53 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:20:45.416 18:08:53 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:20:45.416 18:08:53 -- nvmf/common.sh@293 -- # pci_drivers=() 00:20:45.416 18:08:53 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:20:45.416 18:08:53 -- nvmf/common.sh@295 -- # net_devs=() 00:20:45.416 18:08:53 -- nvmf/common.sh@295 -- # local -ga net_devs 00:20:45.416 18:08:53 -- nvmf/common.sh@296 -- # e810=() 00:20:45.416 18:08:53 -- nvmf/common.sh@296 -- # local -ga e810 00:20:45.416 18:08:53 -- nvmf/common.sh@297 -- # x722=() 00:20:45.416 18:08:53 -- nvmf/common.sh@297 -- # local -ga x722 00:20:45.416 18:08:53 -- nvmf/common.sh@298 -- # mlx=() 00:20:45.416 18:08:53 -- nvmf/common.sh@298 -- # local -ga mlx 00:20:45.416 18:08:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:45.416 18:08:53 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:20:45.416 18:08:53 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:20:45.416 18:08:53 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:20:45.416 18:08:53 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:20:45.416 18:08:53 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:20:45.416 18:08:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:45.416 18:08:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:20:45.416 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:20:45.416 18:08:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:45.416 18:08:53 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:20:45.416 18:08:53 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:20:45.416 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:20:45.416 18:08:53 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:20:45.416 18:08:53 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:20:45.416 18:08:53 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:20:45.416 18:08:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:45.416 18:08:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:45.416 18:08:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:45.416 18:08:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:45.416 18:08:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:20:45.417 Found net devices under 0000:18:00.0: mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:45.417 18:08:53 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:45.417 18:08:53 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:20:45.417 18:08:53 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:45.417 18:08:53 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:20:45.417 Found net devices under 0000:18:00.1: mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:20:45.417 18:08:53 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:20:45.417 18:08:53 -- nvmf/common.sh@403 -- # is_hw=yes 00:20:45.417 18:08:53 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@409 -- # rdma_device_init 00:20:45.417 18:08:53 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:20:45.417 18:08:53 -- nvmf/common.sh@58 -- # uname 00:20:45.417 18:08:53 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:20:45.417 18:08:53 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:20:45.417 18:08:53 -- nvmf/common.sh@63 -- # modprobe ib_core 00:20:45.417 18:08:53 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:20:45.417 18:08:53 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:20:45.417 18:08:53 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:20:45.417 18:08:53 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:20:45.417 18:08:53 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:20:45.417 18:08:53 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:20:45.417 18:08:53 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:20:45.417 18:08:53 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:20:45.417 18:08:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:45.417 18:08:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:45.417 18:08:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:45.417 18:08:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:45.417 18:08:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:45.417 18:08:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@105 -- # continue 2 00:20:45.417 18:08:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@105 -- # continue 2 00:20:45.417 18:08:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:45.417 18:08:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:45.417 18:08:53 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:20:45.417 18:08:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:20:45.417 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:45.417 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:20:45.417 altname enp24s0f0np0 00:20:45.417 altname ens785f0np0 00:20:45.417 inet 192.168.100.8/24 scope global mlx_0_0 00:20:45.417 valid_lft forever preferred_lft forever 00:20:45.417 18:08:53 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:20:45.417 18:08:53 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:45.417 18:08:53 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:20:45.417 18:08:53 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:20:45.417 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:20:45.417 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:20:45.417 altname enp24s0f1np1 00:20:45.417 altname ens785f1np1 00:20:45.417 inet 192.168.100.9/24 scope global mlx_0_1 00:20:45.417 valid_lft forever preferred_lft forever 00:20:45.417 18:08:53 -- nvmf/common.sh@411 -- # return 0 00:20:45.417 18:08:53 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:20:45.417 18:08:53 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:20:45.417 18:08:53 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:20:45.417 18:08:53 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:20:45.417 18:08:53 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:20:45.417 18:08:53 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:20:45.417 18:08:53 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:20:45.417 18:08:53 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:20:45.417 18:08:53 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:20:45.417 18:08:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@105 -- # continue 2 00:20:45.417 18:08:53 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:20:45.417 18:08:53 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:20:45.417 18:08:53 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@105 -- # continue 2 00:20:45.417 18:08:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:45.417 18:08:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:45.417 18:08:53 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:20:45.417 18:08:53 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:20:45.417 18:08:53 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:20:45.417 18:08:53 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:20:45.417 192.168.100.9' 00:20:45.417 18:08:53 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:20:45.417 192.168.100.9' 00:20:45.417 18:08:53 -- nvmf/common.sh@446 -- # head -n 1 00:20:45.417 18:08:53 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:20:45.417 18:08:53 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:20:45.417 192.168.100.9' 00:20:45.417 18:08:53 -- nvmf/common.sh@447 -- # tail -n +2 00:20:45.417 18:08:53 -- nvmf/common.sh@447 -- # head -n 1 00:20:45.417 18:08:53 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:20:45.417 18:08:53 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:20:45.417 18:08:53 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:20:45.417 18:08:53 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:20:45.417 18:08:53 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:20:45.417 18:08:53 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:20:45.417 18:08:53 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:20:45.417 18:08:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:20:45.417 18:08:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:20:45.417 18:08:53 -- common/autotest_common.sh@10 -- # set +x 00:20:45.417 18:08:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:20:45.417 18:08:53 -- nvmf/common.sh@470 -- # nvmfpid=1031061 00:20:45.417 18:08:53 -- nvmf/common.sh@471 -- # waitforlisten 1031061 00:20:45.417 18:08:53 -- common/autotest_common.sh@827 -- # '[' -z 1031061 ']' 00:20:45.417 18:08:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:45.417 18:08:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:20:45.417 18:08:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:45.417 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:45.417 18:08:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:20:45.417 18:08:53 -- common/autotest_common.sh@10 -- # set +x 00:20:45.417 [2024-04-26 18:08:53.919434] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:20:45.417 [2024-04-26 18:08:53.919497] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:45.417 EAL: No free 2048 kB hugepages reported on node 1 00:20:45.417 [2024-04-26 18:08:53.990447] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:20:45.417 [2024-04-26 18:08:54.077610] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:45.417 [2024-04-26 18:08:54.077650] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:45.417 [2024-04-26 18:08:54.077660] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:20:45.417 [2024-04-26 18:08:54.077669] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:20:45.417 [2024-04-26 18:08:54.077677] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:45.417 [2024-04-26 18:08:54.077781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:45.417 [2024-04-26 18:08:54.077893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:45.417 [2024-04-26 18:08:54.077895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:45.675 18:08:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:20:45.675 18:08:54 -- common/autotest_common.sh@860 -- # return 0 00:20:45.675 18:08:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:20:45.675 18:08:54 -- common/autotest_common.sh@726 -- # xtrace_disable 00:20:45.675 18:08:54 -- common/autotest_common.sh@10 -- # set +x 00:20:45.675 18:08:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:45.675 18:08:54 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:20:45.934 [2024-04-26 18:08:54.978721] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xaccd30/0xad1220) succeed. 00:20:45.934 [2024-04-26 18:08:54.989375] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xace2d0/0xb128b0) succeed. 00:20:45.934 18:08:55 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:20:46.192 Malloc0 00:20:46.192 18:08:55 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:46.449 18:08:55 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:46.708 18:08:55 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:46.708 [2024-04-26 18:08:55.803224] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:46.708 18:08:55 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:20:46.965 [2024-04-26 18:08:55.995711] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:20:46.965 18:08:56 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:20:47.223 [2024-04-26 18:08:56.180365] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:20:47.223 18:08:56 -- host/failover.sh@31 -- # bdevperf_pid=1031450 00:20:47.223 18:08:56 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:20:47.223 18:08:56 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:47.224 18:08:56 -- host/failover.sh@34 -- # waitforlisten 1031450 /var/tmp/bdevperf.sock 00:20:47.224 18:08:56 -- common/autotest_common.sh@827 -- # '[' -z 1031450 ']' 00:20:47.224 18:08:56 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:47.224 18:08:56 -- common/autotest_common.sh@832 -- # local max_retries=100 00:20:47.224 18:08:56 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:47.224 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:47.224 18:08:56 -- common/autotest_common.sh@836 -- # xtrace_disable 00:20:47.224 18:08:56 -- common/autotest_common.sh@10 -- # set +x 00:20:48.158 18:08:57 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:20:48.158 18:08:57 -- common/autotest_common.sh@860 -- # return 0 00:20:48.158 18:08:57 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:48.158 NVMe0n1 00:20:48.158 18:08:57 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:48.415 00:20:48.415 18:08:57 -- host/failover.sh@39 -- # run_test_pid=1031634 00:20:48.416 18:08:57 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:20:48.416 18:08:57 -- host/failover.sh@41 -- # sleep 1 00:20:49.791 18:08:58 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:49.791 18:08:58 -- host/failover.sh@45 -- # sleep 3 00:20:53.104 18:09:01 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:20:53.104 00:20:53.104 18:09:02 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:20:53.104 18:09:02 -- host/failover.sh@50 -- # sleep 3 00:20:56.391 18:09:05 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:20:56.391 [2024-04-26 18:09:05.405104] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:20:56.391 18:09:05 -- host/failover.sh@55 -- # sleep 1 00:20:57.327 18:09:06 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:20:57.586 18:09:06 -- host/failover.sh@59 -- # wait 1031634 00:21:04.158 0 00:21:04.158 18:09:12 -- host/failover.sh@61 -- # killprocess 1031450 00:21:04.158 18:09:12 -- common/autotest_common.sh@946 -- # '[' -z 1031450 ']' 00:21:04.158 18:09:12 -- common/autotest_common.sh@950 -- # kill -0 1031450 00:21:04.158 18:09:12 -- common/autotest_common.sh@951 -- # uname 00:21:04.158 18:09:12 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:04.158 18:09:12 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1031450 00:21:04.158 18:09:12 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:21:04.158 18:09:12 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:21:04.158 18:09:12 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1031450' 00:21:04.158 killing process with pid 1031450 00:21:04.158 18:09:12 -- common/autotest_common.sh@965 -- # kill 1031450 00:21:04.158 18:09:12 -- common/autotest_common.sh@970 -- # wait 1031450 00:21:04.158 18:09:13 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:04.158 [2024-04-26 18:08:56.251498] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:21:04.158 [2024-04-26 18:08:56.251561] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1031450 ] 00:21:04.158 EAL: No free 2048 kB hugepages reported on node 1 00:21:04.158 [2024-04-26 18:08:56.321780] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:04.158 [2024-04-26 18:08:56.401428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:04.158 Running I/O for 15 seconds... 00:21:04.159 [2024-04-26 18:08:59.764846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.764892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.764915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:25744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.764927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.764939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:25752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.764949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.764961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:25760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.764971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.764982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:25768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.764991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:25776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:25784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:25800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:25808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:25824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:25832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:25840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:25848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:25856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:25864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:25888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:25896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:25912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:25920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:25928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:25936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:25952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:25968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:25992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:26008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:26016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:26024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:26032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:26040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:26048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:26056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:26064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:26072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:26080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:26088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:26096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:26104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:26112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:26120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:26128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:26136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:26144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.765981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.159 [2024-04-26 18:08:59.765992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:26160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.159 [2024-04-26 18:08:59.766001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:26168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:26184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:26192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:26200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:26208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:26216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:26224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:26232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:26240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:26248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:26256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:26264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:26272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:26280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:26288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:26296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:26304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:26312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:26320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:26336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:26344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:26352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:26360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:26368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:26376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:26384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:26392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:26400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:26416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:26424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:26432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:26448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:26456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:26464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:26472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:26480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:26488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:26496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:26504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:26512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:26520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:26528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.160 [2024-04-26 18:08:59.766941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.160 [2024-04-26 18:08:59.766952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:26536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.766961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.766972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.766981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.766992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:26552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:26560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:26568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:26576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:26584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:26600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:26608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:08:59.767162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:25608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:25632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:25648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:25664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:25672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:25680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.767489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:25720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:08:59.767499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.769422] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:21:04.161 [2024-04-26 18:08:59.769438] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:21:04.161 [2024-04-26 18:08:59.769447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25728 len:8 PRP1 0x0 PRP2 0x0 00:21:04.161 [2024-04-26 18:08:59.769458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:08:59.769505] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:21:04.161 [2024-04-26 18:08:59.769518] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:21:04.161 [2024-04-26 18:08:59.769528] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:04.161 [2024-04-26 18:08:59.772310] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:04.161 [2024-04-26 18:08:59.786982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:04.161 [2024-04-26 18:08:59.835322] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:04.161 [2024-04-26 18:09:03.213468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:117624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:09:03.213512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:117240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:117264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:117288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x181500 00:21:04.161 [2024-04-26 18:09:03.213700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:117632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:09:03.213721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:117640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:09:03.213742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:117648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:09:03.213762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:117656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.161 [2024-04-26 18:09:03.213783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.161 [2024-04-26 18:09:03.213794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:117664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:117672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:117680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:117688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:117696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:117704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:117720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:117728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.213981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.213990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:117744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:117752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:117784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:117792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:117800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:117808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:117816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:117840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:117848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:117856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:117880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:117888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:117904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:117912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:117920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:117928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:117944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:117952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.162 [2024-04-26 18:09:03.214577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:117968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.162 [2024-04-26 18:09:03.214587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:117976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:117992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:118000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:118016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:118024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:118032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:118040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:118056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:118064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.163 [2024-04-26 18:09:03.214852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:117336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:117344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.214988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.214997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:117360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:117400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:117408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:117416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:117424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:117432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:117456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:117464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:117472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:117504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:117512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:117528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:117536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x181500 00:21:04.163 [2024-04-26 18:09:03.215473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.163 [2024-04-26 18:09:03.215484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:117544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:118080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:118096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:118104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:118112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:118120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:117568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:117584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:117600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:03.215842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:118160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:118176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:118192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.215982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.215993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:118224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:118232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:118240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.216116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:03.216125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.217964] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:21:04.164 [2024-04-26 18:09:03.217979] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:21:04.164 [2024-04-26 18:09:03.217989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:118256 len:8 PRP1 0x0 PRP2 0x0 00:21:04.164 [2024-04-26 18:09:03.217999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:03.218046] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:21:04.164 [2024-04-26 18:09:03.218059] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4421 to 192.168.100.8:4422 00:21:04.164 [2024-04-26 18:09:03.218070] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:04.164 [2024-04-26 18:09:03.220861] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:04.164 [2024-04-26 18:09:03.235257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:04.164 [2024-04-26 18:09:03.280704] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:04.164 [2024-04-26 18:09:07.603714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:91568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:91576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:91584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:91592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:91600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:91608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:91616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:91624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x181500 00:21:04.164 [2024-04-26 18:09:07.603920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.164 [2024-04-26 18:09:07.603931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:91824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.164 [2024-04-26 18:09:07.603940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.603952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:91832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.603961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.603972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:91840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.603981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.603992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:91848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:91856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:91864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:91872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:91880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:91888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:91896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:91904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:91912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:91920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:91928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:91936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:91944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:91952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:91960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:91968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:91976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:91984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:91992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:92000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:92008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:91632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x181500 00:21:04.165 [2024-04-26 18:09:07.604435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:92016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:92024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:92032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:92040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:92048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:92056 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:92064 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:92072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:92080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:92088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:92096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:92104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:92112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:92120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:92128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:92136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:92144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:92152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:92160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:92168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:92176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:92184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.165 [2024-04-26 18:09:07.604883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.165 [2024-04-26 18:09:07.604894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:92192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.604904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.604914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:92200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.604923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.604934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:92208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.604943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.604954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:92216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.604964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.604974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:92224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.604983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.604994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:92232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:92240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:92248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:92256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:92264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:91640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:91648 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:91656 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:91664 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:91672 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:91680 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:91688 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:92272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:92280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:92288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:92296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:92304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:92312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:92320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:92328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.166 [2024-04-26 18:09:07.605396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:91696 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:91704 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:91712 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:91720 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:91728 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:91736 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:91744 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:91752 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:91760 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:91768 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:91776 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:91784 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:91792 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:91800 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x181500 00:21:04.166 [2024-04-26 18:09:07.605685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.166 [2024-04-26 18:09:07.605699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:91808 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x181500 00:21:04.167 [2024-04-26 18:09:07.605708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:91816 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x181500 00:21:04.167 [2024-04-26 18:09:07.605729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:92336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:92344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:92352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:92360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:92368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:92376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:92384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:92392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:92400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:92408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:92416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:92424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.605987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:92432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.605996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:92440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:92448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:92456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:92464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:92472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:92480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:92488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:92496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:92504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:92512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:92520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:92528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:92536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:92544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:92552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:92560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:92568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.606357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:92576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:21:04.167 [2024-04-26 18:09:07.606367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.608037] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:21:04.167 [2024-04-26 18:09:07.608054] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:21:04.167 [2024-04-26 18:09:07.608063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:92584 len:8 PRP1 0x0 PRP2 0x0 00:21:04.167 [2024-04-26 18:09:07.608074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:21:04.167 [2024-04-26 18:09:07.608117] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4940 was disconnected and freed. reset controller. 00:21:04.167 [2024-04-26 18:09:07.608129] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4422 to 192.168.100.8:4420 00:21:04.167 [2024-04-26 18:09:07.608139] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:04.167 [2024-04-26 18:09:07.610919] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:04.167 [2024-04-26 18:09:07.624981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:04.167 [2024-04-26 18:09:07.674941] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:04.167 00:21:04.167 Latency(us) 00:21:04.167 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:04.167 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:21:04.167 Verification LBA range: start 0x0 length 0x4000 00:21:04.167 NVMe0n1 : 15.01 14282.42 55.79 341.01 0.00 8733.63 350.83 1021221.84 00:21:04.167 =================================================================================================================== 00:21:04.167 Total : 14282.42 55.79 341.01 0.00 8733.63 350.83 1021221.84 00:21:04.167 Received shutdown signal, test time was about 15.000000 seconds 00:21:04.167 00:21:04.167 Latency(us) 00:21:04.167 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:04.167 =================================================================================================================== 00:21:04.167 Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:04.167 18:09:13 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:21:04.167 18:09:13 -- host/failover.sh@65 -- # count=3 00:21:04.167 18:09:13 -- host/failover.sh@67 -- # (( count != 3 )) 00:21:04.167 18:09:13 -- host/failover.sh@73 -- # bdevperf_pid=1034132 00:21:04.167 18:09:13 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:21:04.167 18:09:13 -- host/failover.sh@75 -- # waitforlisten 1034132 /var/tmp/bdevperf.sock 00:21:04.167 18:09:13 -- common/autotest_common.sh@827 -- # '[' -z 1034132 ']' 00:21:04.167 18:09:13 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:04.167 18:09:13 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:04.167 18:09:13 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:04.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:04.167 18:09:13 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:04.167 18:09:13 -- common/autotest_common.sh@10 -- # set +x 00:21:04.734 18:09:13 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:04.734 18:09:13 -- common/autotest_common.sh@860 -- # return 0 00:21:04.734 18:09:13 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4421 00:21:04.992 [2024-04-26 18:09:14.058675] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4421 *** 00:21:04.992 18:09:14 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4422 00:21:05.251 [2024-04-26 18:09:14.247328] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4422 *** 00:21:05.251 18:09:14 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:05.509 NVMe0n1 00:21:05.509 18:09:14 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:05.768 00:21:05.768 18:09:14 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:06.028 00:21:06.028 18:09:15 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:06.028 18:09:15 -- host/failover.sh@82 -- # grep -q NVMe0 00:21:06.028 18:09:15 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:06.287 18:09:15 -- host/failover.sh@87 -- # sleep 3 00:21:09.571 18:09:18 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:09.571 18:09:18 -- host/failover.sh@88 -- # grep -q NVMe0 00:21:09.571 18:09:18 -- host/failover.sh@90 -- # run_test_pid=1034864 00:21:09.571 18:09:18 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:09.571 18:09:18 -- host/failover.sh@92 -- # wait 1034864 00:21:10.945 0 00:21:10.945 18:09:19 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:10.945 [2024-04-26 18:09:13.072881] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:21:10.945 [2024-04-26 18:09:13.072940] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1034132 ] 00:21:10.945 EAL: No free 2048 kB hugepages reported on node 1 00:21:10.945 [2024-04-26 18:09:13.145353] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:10.945 [2024-04-26 18:09:13.222640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:10.945 [2024-04-26 18:09:15.376952] bdev_nvme.c:1857:bdev_nvme_failover_trid: *NOTICE*: Start failover from 192.168.100.8:4420 to 192.168.100.8:4421 00:21:10.945 [2024-04-26 18:09:15.377494] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:21:10.945 [2024-04-26 18:09:15.377530] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:21:10.945 [2024-04-26 18:09:15.393790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:21:10.945 [2024-04-26 18:09:15.410091] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:21:10.945 Running I/O for 1 seconds... 00:21:10.945 00:21:10.945 Latency(us) 00:21:10.945 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:10.945 Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:21:10.945 Verification LBA range: start 0x0 length 0x4000 00:21:10.945 NVMe0n1 : 1.00 18100.54 70.71 0.00 0.00 7033.02 2535.96 12822.26 00:21:10.945 =================================================================================================================== 00:21:10.945 Total : 18100.54 70.71 0.00 0.00 7033.02 2535.96 12822.26 00:21:10.945 18:09:19 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:10.945 18:09:19 -- host/failover.sh@95 -- # grep -q NVMe0 00:21:10.945 18:09:19 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:10.945 18:09:20 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:10.945 18:09:20 -- host/failover.sh@99 -- # grep -q NVMe0 00:21:11.202 18:09:20 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t rdma -a 192.168.100.8 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:21:11.460 18:09:20 -- host/failover.sh@101 -- # sleep 3 00:21:14.741 18:09:23 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:21:14.741 18:09:23 -- host/failover.sh@103 -- # grep -q NVMe0 00:21:14.741 18:09:23 -- host/failover.sh@108 -- # killprocess 1034132 00:21:14.741 18:09:23 -- common/autotest_common.sh@946 -- # '[' -z 1034132 ']' 00:21:14.741 18:09:23 -- common/autotest_common.sh@950 -- # kill -0 1034132 00:21:14.741 18:09:23 -- common/autotest_common.sh@951 -- # uname 00:21:14.741 18:09:23 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:14.741 18:09:23 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1034132 00:21:14.741 18:09:23 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:21:14.741 18:09:23 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:21:14.741 18:09:23 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1034132' 00:21:14.741 killing process with pid 1034132 00:21:14.741 18:09:23 -- common/autotest_common.sh@965 -- # kill 1034132 00:21:14.741 18:09:23 -- common/autotest_common.sh@970 -- # wait 1034132 00:21:14.998 18:09:23 -- host/failover.sh@110 -- # sync 00:21:14.998 18:09:23 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:14.998 18:09:24 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:21:14.998 18:09:24 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/try.txt 00:21:14.998 18:09:24 -- host/failover.sh@116 -- # nvmftestfini 00:21:14.998 18:09:24 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:14.998 18:09:24 -- nvmf/common.sh@117 -- # sync 00:21:14.998 18:09:24 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:14.998 18:09:24 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:14.998 18:09:24 -- nvmf/common.sh@120 -- # set +e 00:21:14.998 18:09:24 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:14.998 18:09:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:14.998 rmmod nvme_rdma 00:21:14.998 rmmod nvme_fabrics 00:21:15.257 18:09:24 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:15.257 18:09:24 -- nvmf/common.sh@124 -- # set -e 00:21:15.257 18:09:24 -- nvmf/common.sh@125 -- # return 0 00:21:15.257 18:09:24 -- nvmf/common.sh@478 -- # '[' -n 1031061 ']' 00:21:15.257 18:09:24 -- nvmf/common.sh@479 -- # killprocess 1031061 00:21:15.257 18:09:24 -- common/autotest_common.sh@946 -- # '[' -z 1031061 ']' 00:21:15.257 18:09:24 -- common/autotest_common.sh@950 -- # kill -0 1031061 00:21:15.257 18:09:24 -- common/autotest_common.sh@951 -- # uname 00:21:15.257 18:09:24 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:21:15.257 18:09:24 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1031061 00:21:15.257 18:09:24 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:21:15.257 18:09:24 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:21:15.257 18:09:24 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1031061' 00:21:15.257 killing process with pid 1031061 00:21:15.257 18:09:24 -- common/autotest_common.sh@965 -- # kill 1031061 00:21:15.257 18:09:24 -- common/autotest_common.sh@970 -- # wait 1031061 00:21:15.257 [2024-04-26 18:09:24.336299] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:21:15.516 18:09:24 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:15.516 18:09:24 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:15.516 00:21:15.516 real 0m36.925s 00:21:15.516 user 2m4.331s 00:21:15.516 sys 0m7.200s 00:21:15.516 18:09:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:15.516 18:09:24 -- common/autotest_common.sh@10 -- # set +x 00:21:15.516 ************************************ 00:21:15.516 END TEST nvmf_failover 00:21:15.516 ************************************ 00:21:15.516 18:09:24 -- nvmf/nvmf.sh@99 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:21:15.516 18:09:24 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:15.516 18:09:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:15.516 18:09:24 -- common/autotest_common.sh@10 -- # set +x 00:21:15.775 ************************************ 00:21:15.775 START TEST nvmf_discovery 00:21:15.775 ************************************ 00:21:15.775 18:09:24 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=rdma 00:21:15.775 * Looking for test storage... 00:21:15.775 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:15.775 18:09:24 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:15.775 18:09:24 -- nvmf/common.sh@7 -- # uname -s 00:21:15.775 18:09:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:15.775 18:09:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:15.775 18:09:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:15.775 18:09:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:15.775 18:09:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:15.775 18:09:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:15.775 18:09:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:15.775 18:09:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:15.775 18:09:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:15.775 18:09:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:15.775 18:09:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:15.775 18:09:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:15.775 18:09:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:15.775 18:09:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:15.775 18:09:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:15.775 18:09:24 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:15.775 18:09:24 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:15.775 18:09:24 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:15.775 18:09:24 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:15.775 18:09:24 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:15.775 18:09:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.775 18:09:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.775 18:09:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.775 18:09:24 -- paths/export.sh@5 -- # export PATH 00:21:15.776 18:09:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.776 18:09:24 -- nvmf/common.sh@47 -- # : 0 00:21:15.776 18:09:24 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:15.776 18:09:24 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:15.776 18:09:24 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:15.776 18:09:24 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:15.776 18:09:24 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:15.776 18:09:24 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:15.776 18:09:24 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:15.776 18:09:24 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:15.776 18:09:24 -- host/discovery.sh@11 -- # '[' rdma == rdma ']' 00:21:15.776 18:09:24 -- host/discovery.sh@12 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:21:15.776 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:21:15.776 18:09:24 -- host/discovery.sh@13 -- # exit 0 00:21:15.776 00:21:15.776 real 0m0.129s 00:21:15.776 user 0m0.056s 00:21:15.776 sys 0m0.081s 00:21:15.776 18:09:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:15.776 18:09:24 -- common/autotest_common.sh@10 -- # set +x 00:21:15.776 ************************************ 00:21:15.776 END TEST nvmf_discovery 00:21:15.776 ************************************ 00:21:16.034 18:09:24 -- nvmf/nvmf.sh@100 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:21:16.034 18:09:24 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:16.034 18:09:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:16.034 18:09:24 -- common/autotest_common.sh@10 -- # set +x 00:21:16.034 ************************************ 00:21:16.034 START TEST nvmf_discovery_remove_ifc 00:21:16.034 ************************************ 00:21:16.034 18:09:25 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=rdma 00:21:16.034 * Looking for test storage... 00:21:16.034 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:16.034 18:09:25 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:16.034 18:09:25 -- nvmf/common.sh@7 -- # uname -s 00:21:16.292 18:09:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:16.292 18:09:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:16.292 18:09:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:16.292 18:09:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:16.292 18:09:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:16.292 18:09:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:16.292 18:09:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:16.292 18:09:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:16.292 18:09:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:16.292 18:09:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:16.292 18:09:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:16.292 18:09:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:16.292 18:09:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:16.292 18:09:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:16.292 18:09:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:16.292 18:09:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:16.292 18:09:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:16.292 18:09:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:16.292 18:09:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:16.292 18:09:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:16.292 18:09:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.293 18:09:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.293 18:09:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.293 18:09:25 -- paths/export.sh@5 -- # export PATH 00:21:16.293 18:09:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.293 18:09:25 -- nvmf/common.sh@47 -- # : 0 00:21:16.293 18:09:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:16.293 18:09:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:16.293 18:09:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:16.293 18:09:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:16.293 18:09:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:16.293 18:09:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:16.293 18:09:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:16.293 18:09:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:16.293 18:09:25 -- host/discovery_remove_ifc.sh@14 -- # '[' rdma == rdma ']' 00:21:16.293 18:09:25 -- host/discovery_remove_ifc.sh@15 -- # echo 'Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target.' 00:21:16.293 Skipping tests on RDMA because the rdma stack fails to configure the same IP for host and target. 00:21:16.293 18:09:25 -- host/discovery_remove_ifc.sh@16 -- # exit 0 00:21:16.293 00:21:16.293 real 0m0.135s 00:21:16.293 user 0m0.064s 00:21:16.293 sys 0m0.081s 00:21:16.293 18:09:25 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:16.293 18:09:25 -- common/autotest_common.sh@10 -- # set +x 00:21:16.293 ************************************ 00:21:16.293 END TEST nvmf_discovery_remove_ifc 00:21:16.293 ************************************ 00:21:16.293 18:09:25 -- nvmf/nvmf.sh@101 -- # run_test nvmf_identify_kernel_target /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:21:16.293 18:09:25 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:16.293 18:09:25 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:16.293 18:09:25 -- common/autotest_common.sh@10 -- # set +x 00:21:16.293 ************************************ 00:21:16.293 START TEST nvmf_identify_kernel_target 00:21:16.293 ************************************ 00:21:16.293 18:09:25 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/identify_kernel_nvmf.sh --transport=rdma 00:21:16.551 * Looking for test storage... 00:21:16.551 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:16.551 18:09:25 -- host/identify_kernel_nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:16.551 18:09:25 -- nvmf/common.sh@7 -- # uname -s 00:21:16.551 18:09:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:16.551 18:09:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:16.551 18:09:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:16.551 18:09:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:16.551 18:09:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:16.551 18:09:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:16.551 18:09:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:16.551 18:09:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:16.551 18:09:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:16.551 18:09:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:16.551 18:09:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:16.551 18:09:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:16.551 18:09:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:16.551 18:09:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:16.551 18:09:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:16.551 18:09:25 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:16.551 18:09:25 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:16.551 18:09:25 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:16.551 18:09:25 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:16.551 18:09:25 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:16.551 18:09:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.551 18:09:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.551 18:09:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.551 18:09:25 -- paths/export.sh@5 -- # export PATH 00:21:16.551 18:09:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:16.551 18:09:25 -- nvmf/common.sh@47 -- # : 0 00:21:16.551 18:09:25 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:16.551 18:09:25 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:16.551 18:09:25 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:16.551 18:09:25 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:16.551 18:09:25 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:16.551 18:09:25 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:16.551 18:09:25 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:16.551 18:09:25 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:16.551 18:09:25 -- host/identify_kernel_nvmf.sh@11 -- # nvmftestinit 00:21:16.551 18:09:25 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:16.551 18:09:25 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:16.551 18:09:25 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:16.551 18:09:25 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:16.551 18:09:25 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:16.551 18:09:25 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:16.551 18:09:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:16.551 18:09:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:16.551 18:09:25 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:16.551 18:09:25 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:16.551 18:09:25 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:16.551 18:09:25 -- common/autotest_common.sh@10 -- # set +x 00:21:23.116 18:09:31 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:23.116 18:09:31 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:23.116 18:09:31 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:23.116 18:09:31 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:23.116 18:09:31 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:23.116 18:09:31 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:23.116 18:09:31 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:23.116 18:09:31 -- nvmf/common.sh@295 -- # net_devs=() 00:21:23.116 18:09:31 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:23.116 18:09:31 -- nvmf/common.sh@296 -- # e810=() 00:21:23.117 18:09:31 -- nvmf/common.sh@296 -- # local -ga e810 00:21:23.117 18:09:31 -- nvmf/common.sh@297 -- # x722=() 00:21:23.117 18:09:31 -- nvmf/common.sh@297 -- # local -ga x722 00:21:23.117 18:09:31 -- nvmf/common.sh@298 -- # mlx=() 00:21:23.117 18:09:31 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:23.117 18:09:31 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:23.117 18:09:31 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:23.117 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:23.117 18:09:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:23.117 18:09:31 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:23.117 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:23.117 18:09:31 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:23.117 18:09:31 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.117 18:09:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.117 18:09:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:23.117 Found net devices under 0000:18:00.0: mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:23.117 18:09:31 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:23.117 18:09:31 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:23.117 Found net devices under 0000:18:00.1: mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:23.117 18:09:31 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:23.117 18:09:31 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:23.117 18:09:31 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:23.117 18:09:31 -- nvmf/common.sh@58 -- # uname 00:21:23.117 18:09:31 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:23.117 18:09:31 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:23.117 18:09:31 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:23.117 18:09:31 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:23.117 18:09:31 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:23.117 18:09:31 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:23.117 18:09:31 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:23.117 18:09:31 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:23.117 18:09:31 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:23.117 18:09:31 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:23.117 18:09:31 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:23.117 18:09:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:23.117 18:09:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:23.117 18:09:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:23.117 18:09:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:23.117 18:09:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@105 -- # continue 2 00:21:23.117 18:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@105 -- # continue 2 00:21:23.117 18:09:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:23.117 18:09:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:23.117 18:09:31 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:23.117 18:09:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:23.117 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:23.117 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:21:23.117 altname enp24s0f0np0 00:21:23.117 altname ens785f0np0 00:21:23.117 inet 192.168.100.8/24 scope global mlx_0_0 00:21:23.117 valid_lft forever preferred_lft forever 00:21:23.117 18:09:31 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:23.117 18:09:31 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:23.117 18:09:31 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:23.117 18:09:31 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:23.117 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:23.117 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:21:23.117 altname enp24s0f1np1 00:21:23.117 altname ens785f1np1 00:21:23.117 inet 192.168.100.9/24 scope global mlx_0_1 00:21:23.117 valid_lft forever preferred_lft forever 00:21:23.117 18:09:31 -- nvmf/common.sh@411 -- # return 0 00:21:23.117 18:09:31 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:23.117 18:09:31 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:23.117 18:09:31 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:23.117 18:09:31 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:23.117 18:09:31 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:23.117 18:09:31 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:23.117 18:09:31 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:23.117 18:09:31 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:23.117 18:09:31 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:23.117 18:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@105 -- # continue 2 00:21:23.117 18:09:31 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:23.117 18:09:31 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:23.117 18:09:31 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@105 -- # continue 2 00:21:23.117 18:09:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:23.117 18:09:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:23.117 18:09:31 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:23.117 18:09:31 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:23.117 18:09:31 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:23.117 18:09:31 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:23.117 192.168.100.9' 00:21:23.118 18:09:31 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:23.118 192.168.100.9' 00:21:23.118 18:09:31 -- nvmf/common.sh@446 -- # head -n 1 00:21:23.118 18:09:31 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:23.118 18:09:31 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:23.118 192.168.100.9' 00:21:23.118 18:09:31 -- nvmf/common.sh@447 -- # tail -n +2 00:21:23.118 18:09:31 -- nvmf/common.sh@447 -- # head -n 1 00:21:23.118 18:09:31 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:23.118 18:09:31 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:23.118 18:09:31 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:23.118 18:09:31 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:23.118 18:09:31 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:23.118 18:09:31 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:23.118 18:09:31 -- host/identify_kernel_nvmf.sh@13 -- # trap 'nvmftestfini || :; clean_kernel_target' EXIT 00:21:23.118 18:09:31 -- host/identify_kernel_nvmf.sh@15 -- # get_main_ns_ip 00:21:23.118 18:09:31 -- nvmf/common.sh@717 -- # local ip 00:21:23.118 18:09:31 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:23.118 18:09:31 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:23.118 18:09:31 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:23.118 18:09:31 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:23.118 18:09:31 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:23.118 18:09:31 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:23.118 18:09:31 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:23.118 18:09:31 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:23.118 18:09:31 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:23.118 18:09:31 -- host/identify_kernel_nvmf.sh@15 -- # target_ip=192.168.100.8 00:21:23.118 18:09:31 -- host/identify_kernel_nvmf.sh@16 -- # configure_kernel_target nqn.2016-06.io.spdk:testnqn 192.168.100.8 00:21:23.118 18:09:31 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2016-06.io.spdk:testnqn kernel_target_ip=192.168.100.8 00:21:23.118 18:09:31 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:21:23.118 18:09:31 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:23.118 18:09:31 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:23.118 18:09:31 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:21:23.118 18:09:31 -- nvmf/common.sh@628 -- # local block nvme 00:21:23.118 18:09:31 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:21:23.118 18:09:31 -- nvmf/common.sh@631 -- # modprobe nvmet 00:21:23.118 18:09:31 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:21:23.118 18:09:31 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:21:26.405 Waiting for block devices as requested 00:21:26.405 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:21:26.405 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:26.405 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:26.405 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:26.405 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:26.405 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:26.664 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:26.664 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:26.664 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:26.664 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:26.923 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:26.923 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:26.923 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:27.182 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:27.182 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:27.182 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:27.441 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:27.441 18:09:36 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:21:27.441 18:09:36 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:21:27.441 18:09:36 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:21:27.441 18:09:36 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:21:27.442 18:09:36 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:21:27.442 18:09:36 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:21:27.442 18:09:36 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:21:27.442 18:09:36 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:21:27.442 18:09:36 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:21:27.442 No valid GPT data, bailing 00:21:27.442 18:09:36 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:21:27.442 18:09:36 -- scripts/common.sh@391 -- # pt= 00:21:27.442 18:09:36 -- scripts/common.sh@392 -- # return 1 00:21:27.442 18:09:36 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:21:27.442 18:09:36 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:21:27.442 18:09:36 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:27.442 18:09:36 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:27.442 18:09:36 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:21:27.700 18:09:36 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2016-06.io.spdk:testnqn 00:21:27.700 18:09:36 -- nvmf/common.sh@656 -- # echo 1 00:21:27.700 18:09:36 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:21:27.700 18:09:36 -- nvmf/common.sh@658 -- # echo 1 00:21:27.701 18:09:36 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:21:27.701 18:09:36 -- nvmf/common.sh@661 -- # echo rdma 00:21:27.701 18:09:36 -- nvmf/common.sh@662 -- # echo 4420 00:21:27.701 18:09:36 -- nvmf/common.sh@663 -- # echo ipv4 00:21:27.701 18:09:36 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn /sys/kernel/config/nvmet/ports/1/subsystems/ 00:21:27.701 18:09:36 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:21:27.701 00:21:27.701 Discovery Log Number of Records 2, Generation counter 2 00:21:27.701 =====Discovery Log Entry 0====== 00:21:27.701 trtype: rdma 00:21:27.701 adrfam: ipv4 00:21:27.701 subtype: current discovery subsystem 00:21:27.701 treq: not specified, sq flow control disable supported 00:21:27.701 portid: 1 00:21:27.701 trsvcid: 4420 00:21:27.701 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:21:27.701 traddr: 192.168.100.8 00:21:27.701 eflags: none 00:21:27.701 rdma_prtype: not specified 00:21:27.701 rdma_qptype: connected 00:21:27.701 rdma_cms: rdma-cm 00:21:27.701 rdma_pkey: 0x0000 00:21:27.701 =====Discovery Log Entry 1====== 00:21:27.701 trtype: rdma 00:21:27.701 adrfam: ipv4 00:21:27.701 subtype: nvme subsystem 00:21:27.701 treq: not specified, sq flow control disable supported 00:21:27.701 portid: 1 00:21:27.701 trsvcid: 4420 00:21:27.701 subnqn: nqn.2016-06.io.spdk:testnqn 00:21:27.701 traddr: 192.168.100.8 00:21:27.701 eflags: none 00:21:27.701 rdma_prtype: not specified 00:21:27.701 rdma_qptype: connected 00:21:27.701 rdma_cms: rdma-cm 00:21:27.701 rdma_pkey: 0x0000 00:21:27.701 18:09:36 -- host/identify_kernel_nvmf.sh@18 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 00:21:27.701 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' 00:21:27.701 EAL: No free 2048 kB hugepages reported on node 1 00:21:27.960 ===================================================== 00:21:27.960 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2014-08.org.nvmexpress.discovery 00:21:27.960 ===================================================== 00:21:27.960 Controller Capabilities/Features 00:21:27.960 ================================ 00:21:27.960 Vendor ID: 0000 00:21:27.960 Subsystem Vendor ID: 0000 00:21:27.960 Serial Number: b9420e69ab3706f0df69 00:21:27.960 Model Number: Linux 00:21:27.960 Firmware Version: 6.7.0-68 00:21:27.960 Recommended Arb Burst: 0 00:21:27.960 IEEE OUI Identifier: 00 00 00 00:21:27.960 Multi-path I/O 00:21:27.960 May have multiple subsystem ports: No 00:21:27.960 May have multiple controllers: No 00:21:27.960 Associated with SR-IOV VF: No 00:21:27.960 Max Data Transfer Size: Unlimited 00:21:27.960 Max Number of Namespaces: 0 00:21:27.960 Max Number of I/O Queues: 1024 00:21:27.960 NVMe Specification Version (VS): 1.3 00:21:27.960 NVMe Specification Version (Identify): 1.3 00:21:27.960 Maximum Queue Entries: 128 00:21:27.960 Contiguous Queues Required: No 00:21:27.960 Arbitration Mechanisms Supported 00:21:27.960 Weighted Round Robin: Not Supported 00:21:27.960 Vendor Specific: Not Supported 00:21:27.960 Reset Timeout: 7500 ms 00:21:27.960 Doorbell Stride: 4 bytes 00:21:27.960 NVM Subsystem Reset: Not Supported 00:21:27.960 Command Sets Supported 00:21:27.960 NVM Command Set: Supported 00:21:27.960 Boot Partition: Not Supported 00:21:27.960 Memory Page Size Minimum: 4096 bytes 00:21:27.960 Memory Page Size Maximum: 4096 bytes 00:21:27.960 Persistent Memory Region: Not Supported 00:21:27.960 Optional Asynchronous Events Supported 00:21:27.960 Namespace Attribute Notices: Not Supported 00:21:27.960 Firmware Activation Notices: Not Supported 00:21:27.960 ANA Change Notices: Not Supported 00:21:27.960 PLE Aggregate Log Change Notices: Not Supported 00:21:27.960 LBA Status Info Alert Notices: Not Supported 00:21:27.960 EGE Aggregate Log Change Notices: Not Supported 00:21:27.960 Normal NVM Subsystem Shutdown event: Not Supported 00:21:27.960 Zone Descriptor Change Notices: Not Supported 00:21:27.960 Discovery Log Change Notices: Supported 00:21:27.960 Controller Attributes 00:21:27.960 128-bit Host Identifier: Not Supported 00:21:27.960 Non-Operational Permissive Mode: Not Supported 00:21:27.960 NVM Sets: Not Supported 00:21:27.960 Read Recovery Levels: Not Supported 00:21:27.960 Endurance Groups: Not Supported 00:21:27.960 Predictable Latency Mode: Not Supported 00:21:27.960 Traffic Based Keep ALive: Not Supported 00:21:27.960 Namespace Granularity: Not Supported 00:21:27.960 SQ Associations: Not Supported 00:21:27.960 UUID List: Not Supported 00:21:27.960 Multi-Domain Subsystem: Not Supported 00:21:27.960 Fixed Capacity Management: Not Supported 00:21:27.961 Variable Capacity Management: Not Supported 00:21:27.961 Delete Endurance Group: Not Supported 00:21:27.961 Delete NVM Set: Not Supported 00:21:27.961 Extended LBA Formats Supported: Not Supported 00:21:27.961 Flexible Data Placement Supported: Not Supported 00:21:27.961 00:21:27.961 Controller Memory Buffer Support 00:21:27.961 ================================ 00:21:27.961 Supported: No 00:21:27.961 00:21:27.961 Persistent Memory Region Support 00:21:27.961 ================================ 00:21:27.961 Supported: No 00:21:27.961 00:21:27.961 Admin Command Set Attributes 00:21:27.961 ============================ 00:21:27.961 Security Send/Receive: Not Supported 00:21:27.961 Format NVM: Not Supported 00:21:27.961 Firmware Activate/Download: Not Supported 00:21:27.961 Namespace Management: Not Supported 00:21:27.961 Device Self-Test: Not Supported 00:21:27.961 Directives: Not Supported 00:21:27.961 NVMe-MI: Not Supported 00:21:27.961 Virtualization Management: Not Supported 00:21:27.961 Doorbell Buffer Config: Not Supported 00:21:27.961 Get LBA Status Capability: Not Supported 00:21:27.961 Command & Feature Lockdown Capability: Not Supported 00:21:27.961 Abort Command Limit: 1 00:21:27.961 Async Event Request Limit: 1 00:21:27.961 Number of Firmware Slots: N/A 00:21:27.961 Firmware Slot 1 Read-Only: N/A 00:21:27.961 Firmware Activation Without Reset: N/A 00:21:27.961 Multiple Update Detection Support: N/A 00:21:27.961 Firmware Update Granularity: No Information Provided 00:21:27.961 Per-Namespace SMART Log: No 00:21:27.961 Asymmetric Namespace Access Log Page: Not Supported 00:21:27.961 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:21:27.961 Command Effects Log Page: Not Supported 00:21:27.961 Get Log Page Extended Data: Supported 00:21:27.961 Telemetry Log Pages: Not Supported 00:21:27.961 Persistent Event Log Pages: Not Supported 00:21:27.961 Supported Log Pages Log Page: May Support 00:21:27.961 Commands Supported & Effects Log Page: Not Supported 00:21:27.961 Feature Identifiers & Effects Log Page:May Support 00:21:27.961 NVMe-MI Commands & Effects Log Page: May Support 00:21:27.961 Data Area 4 for Telemetry Log: Not Supported 00:21:27.961 Error Log Page Entries Supported: 1 00:21:27.961 Keep Alive: Not Supported 00:21:27.961 00:21:27.961 NVM Command Set Attributes 00:21:27.961 ========================== 00:21:27.961 Submission Queue Entry Size 00:21:27.961 Max: 1 00:21:27.961 Min: 1 00:21:27.961 Completion Queue Entry Size 00:21:27.961 Max: 1 00:21:27.961 Min: 1 00:21:27.961 Number of Namespaces: 0 00:21:27.961 Compare Command: Not Supported 00:21:27.961 Write Uncorrectable Command: Not Supported 00:21:27.961 Dataset Management Command: Not Supported 00:21:27.961 Write Zeroes Command: Not Supported 00:21:27.961 Set Features Save Field: Not Supported 00:21:27.961 Reservations: Not Supported 00:21:27.961 Timestamp: Not Supported 00:21:27.961 Copy: Not Supported 00:21:27.961 Volatile Write Cache: Not Present 00:21:27.961 Atomic Write Unit (Normal): 1 00:21:27.961 Atomic Write Unit (PFail): 1 00:21:27.961 Atomic Compare & Write Unit: 1 00:21:27.961 Fused Compare & Write: Not Supported 00:21:27.961 Scatter-Gather List 00:21:27.961 SGL Command Set: Supported 00:21:27.961 SGL Keyed: Supported 00:21:27.961 SGL Bit Bucket Descriptor: Not Supported 00:21:27.961 SGL Metadata Pointer: Not Supported 00:21:27.961 Oversized SGL: Not Supported 00:21:27.961 SGL Metadata Address: Not Supported 00:21:27.961 SGL Offset: Supported 00:21:27.961 Transport SGL Data Block: Not Supported 00:21:27.961 Replay Protected Memory Block: Not Supported 00:21:27.961 00:21:27.961 Firmware Slot Information 00:21:27.961 ========================= 00:21:27.961 Active slot: 0 00:21:27.961 00:21:27.961 00:21:27.961 Error Log 00:21:27.961 ========= 00:21:27.961 00:21:27.961 Active Namespaces 00:21:27.961 ================= 00:21:27.961 Discovery Log Page 00:21:27.961 ================== 00:21:27.961 Generation Counter: 2 00:21:27.961 Number of Records: 2 00:21:27.961 Record Format: 0 00:21:27.961 00:21:27.961 Discovery Log Entry 0 00:21:27.961 ---------------------- 00:21:27.961 Transport Type: 1 (RDMA) 00:21:27.961 Address Family: 1 (IPv4) 00:21:27.961 Subsystem Type: 3 (Current Discovery Subsystem) 00:21:27.961 Entry Flags: 00:21:27.961 Duplicate Returned Information: 0 00:21:27.961 Explicit Persistent Connection Support for Discovery: 0 00:21:27.961 Transport Requirements: 00:21:27.961 Secure Channel: Not Specified 00:21:27.961 Port ID: 1 (0x0001) 00:21:27.961 Controller ID: 65535 (0xffff) 00:21:27.961 Admin Max SQ Size: 32 00:21:27.961 Transport Service Identifier: 4420 00:21:27.961 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:21:27.961 Transport Address: 192.168.100.8 00:21:27.961 Transport Specific Address Subtype - RDMA 00:21:27.961 RDMA QP Service Type: 1 (Reliable Connected) 00:21:27.961 RDMA Provider Type: 1 (No provider specified) 00:21:27.961 RDMA CM Service: 1 (RDMA_CM) 00:21:27.961 Discovery Log Entry 1 00:21:27.961 ---------------------- 00:21:27.961 Transport Type: 1 (RDMA) 00:21:27.961 Address Family: 1 (IPv4) 00:21:27.961 Subsystem Type: 2 (NVM Subsystem) 00:21:27.961 Entry Flags: 00:21:27.961 Duplicate Returned Information: 0 00:21:27.961 Explicit Persistent Connection Support for Discovery: 0 00:21:27.961 Transport Requirements: 00:21:27.961 Secure Channel: Not Specified 00:21:27.961 Port ID: 1 (0x0001) 00:21:27.961 Controller ID: 65535 (0xffff) 00:21:27.961 Admin Max SQ Size: 32 00:21:27.961 Transport Service Identifier: 4420 00:21:27.961 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:testnqn 00:21:27.961 Transport Address: 192.168.100.8 00:21:27.961 Transport Specific Address Subtype - RDMA 00:21:27.961 RDMA QP Service Type: 1 (Reliable Connected) 00:21:27.961 RDMA Provider Type: 1 (No provider specified) 00:21:27.961 RDMA CM Service: 1 (RDMA_CM) 00:21:27.961 18:09:36 -- host/identify_kernel_nvmf.sh@24 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:testnqn' 00:21:27.961 EAL: No free 2048 kB hugepages reported on node 1 00:21:27.961 get_feature(0x01) failed 00:21:27.961 get_feature(0x02) failed 00:21:27.961 get_feature(0x04) failed 00:21:27.961 ===================================================== 00:21:27.961 NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:testnqn 00:21:27.961 ===================================================== 00:21:27.961 Controller Capabilities/Features 00:21:27.961 ================================ 00:21:27.961 Vendor ID: 0000 00:21:27.961 Subsystem Vendor ID: 0000 00:21:27.961 Serial Number: b2436ad3d0f3dc04d677 00:21:27.961 Model Number: SPDK-nqn.2016-06.io.spdk:testnqn 00:21:27.961 Firmware Version: 6.7.0-68 00:21:27.961 Recommended Arb Burst: 6 00:21:27.961 IEEE OUI Identifier: 00 00 00 00:21:27.961 Multi-path I/O 00:21:27.961 May have multiple subsystem ports: Yes 00:21:27.961 May have multiple controllers: Yes 00:21:27.961 Associated with SR-IOV VF: No 00:21:27.961 Max Data Transfer Size: 1048576 00:21:27.961 Max Number of Namespaces: 1024 00:21:27.961 Max Number of I/O Queues: 128 00:21:27.961 NVMe Specification Version (VS): 1.3 00:21:27.961 NVMe Specification Version (Identify): 1.3 00:21:27.961 Maximum Queue Entries: 128 00:21:27.962 Contiguous Queues Required: No 00:21:27.962 Arbitration Mechanisms Supported 00:21:27.962 Weighted Round Robin: Not Supported 00:21:27.962 Vendor Specific: Not Supported 00:21:27.962 Reset Timeout: 7500 ms 00:21:27.962 Doorbell Stride: 4 bytes 00:21:27.962 NVM Subsystem Reset: Not Supported 00:21:27.962 Command Sets Supported 00:21:27.962 NVM Command Set: Supported 00:21:27.962 Boot Partition: Not Supported 00:21:27.962 Memory Page Size Minimum: 4096 bytes 00:21:27.962 Memory Page Size Maximum: 4096 bytes 00:21:27.962 Persistent Memory Region: Not Supported 00:21:27.962 Optional Asynchronous Events Supported 00:21:27.962 Namespace Attribute Notices: Supported 00:21:27.962 Firmware Activation Notices: Not Supported 00:21:27.962 ANA Change Notices: Supported 00:21:27.962 PLE Aggregate Log Change Notices: Not Supported 00:21:27.962 LBA Status Info Alert Notices: Not Supported 00:21:27.962 EGE Aggregate Log Change Notices: Not Supported 00:21:27.962 Normal NVM Subsystem Shutdown event: Not Supported 00:21:27.962 Zone Descriptor Change Notices: Not Supported 00:21:27.962 Discovery Log Change Notices: Not Supported 00:21:27.962 Controller Attributes 00:21:27.962 128-bit Host Identifier: Supported 00:21:27.962 Non-Operational Permissive Mode: Not Supported 00:21:27.962 NVM Sets: Not Supported 00:21:27.962 Read Recovery Levels: Not Supported 00:21:27.962 Endurance Groups: Not Supported 00:21:27.962 Predictable Latency Mode: Not Supported 00:21:27.962 Traffic Based Keep ALive: Supported 00:21:27.962 Namespace Granularity: Not Supported 00:21:27.962 SQ Associations: Not Supported 00:21:27.962 UUID List: Not Supported 00:21:27.962 Multi-Domain Subsystem: Not Supported 00:21:27.962 Fixed Capacity Management: Not Supported 00:21:27.962 Variable Capacity Management: Not Supported 00:21:27.962 Delete Endurance Group: Not Supported 00:21:27.962 Delete NVM Set: Not Supported 00:21:27.962 Extended LBA Formats Supported: Not Supported 00:21:27.962 Flexible Data Placement Supported: Not Supported 00:21:27.962 00:21:27.962 Controller Memory Buffer Support 00:21:27.962 ================================ 00:21:27.962 Supported: No 00:21:27.962 00:21:27.962 Persistent Memory Region Support 00:21:27.962 ================================ 00:21:27.962 Supported: No 00:21:27.962 00:21:27.962 Admin Command Set Attributes 00:21:27.962 ============================ 00:21:27.962 Security Send/Receive: Not Supported 00:21:27.962 Format NVM: Not Supported 00:21:27.962 Firmware Activate/Download: Not Supported 00:21:27.962 Namespace Management: Not Supported 00:21:27.962 Device Self-Test: Not Supported 00:21:27.962 Directives: Not Supported 00:21:27.962 NVMe-MI: Not Supported 00:21:27.962 Virtualization Management: Not Supported 00:21:27.962 Doorbell Buffer Config: Not Supported 00:21:27.962 Get LBA Status Capability: Not Supported 00:21:27.962 Command & Feature Lockdown Capability: Not Supported 00:21:27.962 Abort Command Limit: 4 00:21:27.962 Async Event Request Limit: 4 00:21:27.962 Number of Firmware Slots: N/A 00:21:27.962 Firmware Slot 1 Read-Only: N/A 00:21:27.962 Firmware Activation Without Reset: N/A 00:21:27.962 Multiple Update Detection Support: N/A 00:21:27.962 Firmware Update Granularity: No Information Provided 00:21:27.962 Per-Namespace SMART Log: Yes 00:21:27.962 Asymmetric Namespace Access Log Page: Supported 00:21:27.962 ANA Transition Time : 10 sec 00:21:27.962 00:21:27.962 Asymmetric Namespace Access Capabilities 00:21:27.962 ANA Optimized State : Supported 00:21:27.962 ANA Non-Optimized State : Supported 00:21:27.962 ANA Inaccessible State : Supported 00:21:27.962 ANA Persistent Loss State : Supported 00:21:27.962 ANA Change State : Supported 00:21:27.962 ANAGRPID is not changed : No 00:21:27.962 Non-Zero ANAGRPID for NS Mgmt Cmd : Not Supported 00:21:27.962 00:21:27.962 ANA Group Identifier Maximum : 128 00:21:27.962 Number of ANA Group Identifiers : 128 00:21:27.962 Max Number of Allowed Namespaces : 1024 00:21:27.962 Subsystem NQN: nqn.2016-06.io.spdk:testnqn 00:21:27.962 Command Effects Log Page: Supported 00:21:27.962 Get Log Page Extended Data: Supported 00:21:27.962 Telemetry Log Pages: Not Supported 00:21:27.962 Persistent Event Log Pages: Not Supported 00:21:27.962 Supported Log Pages Log Page: May Support 00:21:27.962 Commands Supported & Effects Log Page: Not Supported 00:21:27.962 Feature Identifiers & Effects Log Page:May Support 00:21:27.962 NVMe-MI Commands & Effects Log Page: May Support 00:21:27.962 Data Area 4 for Telemetry Log: Not Supported 00:21:27.962 Error Log Page Entries Supported: 128 00:21:27.962 Keep Alive: Supported 00:21:27.962 Keep Alive Granularity: 1000 ms 00:21:27.962 00:21:27.962 NVM Command Set Attributes 00:21:27.962 ========================== 00:21:27.962 Submission Queue Entry Size 00:21:27.962 Max: 64 00:21:27.962 Min: 64 00:21:27.962 Completion Queue Entry Size 00:21:27.962 Max: 16 00:21:27.962 Min: 16 00:21:27.962 Number of Namespaces: 1024 00:21:27.962 Compare Command: Not Supported 00:21:27.962 Write Uncorrectable Command: Not Supported 00:21:27.962 Dataset Management Command: Supported 00:21:27.962 Write Zeroes Command: Supported 00:21:27.962 Set Features Save Field: Not Supported 00:21:27.962 Reservations: Not Supported 00:21:27.962 Timestamp: Not Supported 00:21:27.962 Copy: Not Supported 00:21:27.962 Volatile Write Cache: Present 00:21:27.962 Atomic Write Unit (Normal): 1 00:21:27.962 Atomic Write Unit (PFail): 1 00:21:27.962 Atomic Compare & Write Unit: 1 00:21:27.962 Fused Compare & Write: Not Supported 00:21:27.962 Scatter-Gather List 00:21:27.962 SGL Command Set: Supported 00:21:27.962 SGL Keyed: Supported 00:21:27.962 SGL Bit Bucket Descriptor: Not Supported 00:21:27.962 SGL Metadata Pointer: Not Supported 00:21:27.962 Oversized SGL: Not Supported 00:21:27.962 SGL Metadata Address: Not Supported 00:21:27.962 SGL Offset: Supported 00:21:27.962 Transport SGL Data Block: Not Supported 00:21:27.962 Replay Protected Memory Block: Not Supported 00:21:27.962 00:21:27.962 Firmware Slot Information 00:21:27.962 ========================= 00:21:27.962 Active slot: 0 00:21:27.962 00:21:27.962 Asymmetric Namespace Access 00:21:27.962 =========================== 00:21:27.962 Change Count : 0 00:21:27.962 Number of ANA Group Descriptors : 1 00:21:27.962 ANA Group Descriptor : 0 00:21:27.962 ANA Group ID : 1 00:21:27.962 Number of NSID Values : 1 00:21:27.962 Change Count : 0 00:21:27.962 ANA State : 1 00:21:27.962 Namespace Identifier : 1 00:21:27.962 00:21:27.962 Commands Supported and Effects 00:21:27.962 ============================== 00:21:27.962 Admin Commands 00:21:27.962 -------------- 00:21:27.962 Get Log Page (02h): Supported 00:21:27.962 Identify (06h): Supported 00:21:27.962 Abort (08h): Supported 00:21:27.962 Set Features (09h): Supported 00:21:27.962 Get Features (0Ah): Supported 00:21:27.962 Asynchronous Event Request (0Ch): Supported 00:21:27.962 Keep Alive (18h): Supported 00:21:27.962 I/O Commands 00:21:27.962 ------------ 00:21:27.962 Flush (00h): Supported 00:21:27.962 Write (01h): Supported LBA-Change 00:21:27.962 Read (02h): Supported 00:21:27.962 Write Zeroes (08h): Supported LBA-Change 00:21:27.962 Dataset Management (09h): Supported 00:21:27.962 00:21:27.962 Error Log 00:21:27.962 ========= 00:21:27.962 Entry: 0 00:21:27.962 Error Count: 0x3 00:21:27.962 Submission Queue Id: 0x0 00:21:27.962 Command Id: 0x5 00:21:27.962 Phase Bit: 0 00:21:27.962 Status Code: 0x2 00:21:27.962 Status Code Type: 0x0 00:21:27.962 Do Not Retry: 1 00:21:27.962 Error Location: 0x28 00:21:27.962 LBA: 0x0 00:21:27.962 Namespace: 0x0 00:21:27.962 Vendor Log Page: 0x0 00:21:27.962 ----------- 00:21:27.962 Entry: 1 00:21:27.962 Error Count: 0x2 00:21:27.962 Submission Queue Id: 0x0 00:21:27.962 Command Id: 0x5 00:21:27.962 Phase Bit: 0 00:21:27.962 Status Code: 0x2 00:21:27.962 Status Code Type: 0x0 00:21:27.962 Do Not Retry: 1 00:21:27.962 Error Location: 0x28 00:21:27.962 LBA: 0x0 00:21:27.962 Namespace: 0x0 00:21:27.962 Vendor Log Page: 0x0 00:21:27.962 ----------- 00:21:27.962 Entry: 2 00:21:27.962 Error Count: 0x1 00:21:27.962 Submission Queue Id: 0x0 00:21:27.962 Command Id: 0x0 00:21:27.962 Phase Bit: 0 00:21:27.962 Status Code: 0x2 00:21:27.962 Status Code Type: 0x0 00:21:27.962 Do Not Retry: 1 00:21:27.962 Error Location: 0x28 00:21:27.962 LBA: 0x0 00:21:27.962 Namespace: 0x0 00:21:27.962 Vendor Log Page: 0x0 00:21:27.962 00:21:27.962 Number of Queues 00:21:27.962 ================ 00:21:27.963 Number of I/O Submission Queues: 128 00:21:27.963 Number of I/O Completion Queues: 128 00:21:27.963 00:21:27.963 ZNS Specific Controller Data 00:21:27.963 ============================ 00:21:27.963 Zone Append Size Limit: 0 00:21:27.963 00:21:27.963 00:21:27.963 Active Namespaces 00:21:27.963 ================= 00:21:27.963 get_feature(0x05) failed 00:21:27.963 Namespace ID:1 00:21:27.963 Command Set Identifier: NVM (00h) 00:21:27.963 Deallocate: Supported 00:21:27.963 Deallocated/Unwritten Error: Not Supported 00:21:27.963 Deallocated Read Value: Unknown 00:21:27.963 Deallocate in Write Zeroes: Not Supported 00:21:27.963 Deallocated Guard Field: 0xFFFF 00:21:27.963 Flush: Supported 00:21:27.963 Reservation: Not Supported 00:21:27.963 Namespace Sharing Capabilities: Multiple Controllers 00:21:27.963 Size (in LBAs): 7814037168 (3726GiB) 00:21:27.963 Capacity (in LBAs): 7814037168 (3726GiB) 00:21:27.963 Utilization (in LBAs): 7814037168 (3726GiB) 00:21:27.963 UUID: 68f2a4a5-6308-4c2f-942e-abd113004563 00:21:27.963 Thin Provisioning: Not Supported 00:21:27.963 Per-NS Atomic Units: Yes 00:21:27.963 Atomic Boundary Size (Normal): 0 00:21:27.963 Atomic Boundary Size (PFail): 0 00:21:27.963 Atomic Boundary Offset: 0 00:21:27.963 NGUID/EUI64 Never Reused: No 00:21:27.963 ANA group ID: 1 00:21:27.963 Namespace Write Protected: No 00:21:27.963 Number of LBA Formats: 1 00:21:27.963 Current LBA Format: LBA Format #00 00:21:27.963 LBA Format #00: Data Size: 512 Metadata Size: 0 00:21:27.963 00:21:27.963 18:09:37 -- host/identify_kernel_nvmf.sh@1 -- # nvmftestfini 00:21:27.963 18:09:37 -- nvmf/common.sh@477 -- # nvmfcleanup 00:21:27.963 18:09:37 -- nvmf/common.sh@117 -- # sync 00:21:27.963 18:09:37 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:21:27.963 18:09:37 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:21:27.963 18:09:37 -- nvmf/common.sh@120 -- # set +e 00:21:27.963 18:09:37 -- nvmf/common.sh@121 -- # for i in {1..20} 00:21:27.963 18:09:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:21:27.963 rmmod nvme_rdma 00:21:27.963 rmmod nvme_fabrics 00:21:28.221 18:09:37 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:21:28.221 18:09:37 -- nvmf/common.sh@124 -- # set -e 00:21:28.221 18:09:37 -- nvmf/common.sh@125 -- # return 0 00:21:28.221 18:09:37 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:21:28.221 18:09:37 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:21:28.221 18:09:37 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:21:28.221 18:09:37 -- host/identify_kernel_nvmf.sh@1 -- # clean_kernel_target 00:21:28.221 18:09:37 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn ]] 00:21:28.221 18:09:37 -- nvmf/common.sh@675 -- # echo 0 00:21:28.221 18:09:37 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:28.221 18:09:37 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn/namespaces/1 00:21:28.221 18:09:37 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:21:28.221 18:09:37 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2016-06.io.spdk:testnqn 00:21:28.221 18:09:37 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:21:28.221 18:09:37 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:21:28.221 18:09:37 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:21:31.512 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:21:31.512 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:21:34.800 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:21:34.800 00:21:34.800 real 0m18.200s 00:21:34.800 user 0m4.558s 00:21:34.800 sys 0m9.766s 00:21:34.800 18:09:43 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:21:34.800 18:09:43 -- common/autotest_common.sh@10 -- # set +x 00:21:34.800 ************************************ 00:21:34.800 END TEST nvmf_identify_kernel_target 00:21:34.800 ************************************ 00:21:34.800 18:09:43 -- nvmf/nvmf.sh@102 -- # run_test nvmf_auth /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:21:34.800 18:09:43 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:21:34.800 18:09:43 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:21:34.800 18:09:43 -- common/autotest_common.sh@10 -- # set +x 00:21:34.800 ************************************ 00:21:34.800 START TEST nvmf_auth 00:21:34.800 ************************************ 00:21:34.800 18:09:43 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/auth.sh --transport=rdma 00:21:34.800 * Looking for test storage... 00:21:34.800 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:21:34.800 18:09:43 -- host/auth.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:21:34.800 18:09:43 -- nvmf/common.sh@7 -- # uname -s 00:21:34.800 18:09:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:34.800 18:09:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:34.800 18:09:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:34.800 18:09:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:34.800 18:09:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:34.800 18:09:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:34.800 18:09:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:34.800 18:09:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:34.800 18:09:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:34.800 18:09:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:34.800 18:09:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:21:34.800 18:09:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:21:34.800 18:09:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:34.800 18:09:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:34.800 18:09:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:34.800 18:09:43 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:21:34.800 18:09:43 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:21:34.800 18:09:43 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:34.800 18:09:43 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:34.800 18:09:43 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:34.800 18:09:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:34.800 18:09:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:34.800 18:09:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:34.800 18:09:43 -- paths/export.sh@5 -- # export PATH 00:21:34.800 18:09:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:34.800 18:09:43 -- nvmf/common.sh@47 -- # : 0 00:21:34.800 18:09:43 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:21:34.800 18:09:43 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:21:34.800 18:09:43 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:21:34.800 18:09:43 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:34.800 18:09:43 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:34.800 18:09:43 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:21:34.800 18:09:43 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:21:34.800 18:09:43 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:21:34.800 18:09:43 -- host/auth.sh@13 -- # digests=("sha256" "sha384" "sha512") 00:21:34.800 18:09:43 -- host/auth.sh@16 -- # dhgroups=("ffdhe2048" "ffdhe3072" "ffdhe4096" "ffdhe6144" "ffdhe8192") 00:21:34.800 18:09:43 -- host/auth.sh@17 -- # subnqn=nqn.2024-02.io.spdk:cnode0 00:21:34.800 18:09:43 -- host/auth.sh@18 -- # hostnqn=nqn.2024-02.io.spdk:host0 00:21:34.800 18:09:43 -- host/auth.sh@19 -- # nvmet_subsys=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:34.800 18:09:43 -- host/auth.sh@20 -- # nvmet_host=/sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:21:34.800 18:09:43 -- host/auth.sh@21 -- # keys=() 00:21:34.800 18:09:43 -- host/auth.sh@77 -- # nvmftestinit 00:21:34.800 18:09:43 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:21:34.800 18:09:43 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:34.800 18:09:43 -- nvmf/common.sh@437 -- # prepare_net_devs 00:21:34.800 18:09:43 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:21:34.800 18:09:43 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:21:34.800 18:09:43 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:34.800 18:09:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:34.800 18:09:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:34.800 18:09:43 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:21:34.800 18:09:43 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:21:34.800 18:09:43 -- nvmf/common.sh@285 -- # xtrace_disable 00:21:34.800 18:09:43 -- common/autotest_common.sh@10 -- # set +x 00:21:41.372 18:09:50 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:41.372 18:09:50 -- nvmf/common.sh@291 -- # pci_devs=() 00:21:41.372 18:09:50 -- nvmf/common.sh@291 -- # local -a pci_devs 00:21:41.372 18:09:50 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:21:41.372 18:09:50 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:21:41.372 18:09:50 -- nvmf/common.sh@293 -- # pci_drivers=() 00:21:41.372 18:09:50 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:21:41.372 18:09:50 -- nvmf/common.sh@295 -- # net_devs=() 00:21:41.372 18:09:50 -- nvmf/common.sh@295 -- # local -ga net_devs 00:21:41.372 18:09:50 -- nvmf/common.sh@296 -- # e810=() 00:21:41.372 18:09:50 -- nvmf/common.sh@296 -- # local -ga e810 00:21:41.372 18:09:50 -- nvmf/common.sh@297 -- # x722=() 00:21:41.372 18:09:50 -- nvmf/common.sh@297 -- # local -ga x722 00:21:41.372 18:09:50 -- nvmf/common.sh@298 -- # mlx=() 00:21:41.372 18:09:50 -- nvmf/common.sh@298 -- # local -ga mlx 00:21:41.373 18:09:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:41.373 18:09:50 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:21:41.373 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:21:41.373 18:09:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:41.373 18:09:50 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:21:41.373 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:21:41.373 18:09:50 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:21:41.373 18:09:50 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.373 18:09:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.373 18:09:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:21:41.373 Found net devices under 0000:18:00.0: mlx_0_0 00:21:41.373 18:09:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:41.373 18:09:50 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:41.373 18:09:50 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:21:41.373 Found net devices under 0000:18:00.1: mlx_0_1 00:21:41.373 18:09:50 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:21:41.373 18:09:50 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@403 -- # is_hw=yes 00:21:41.373 18:09:50 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@409 -- # rdma_device_init 00:21:41.373 18:09:50 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:21:41.373 18:09:50 -- nvmf/common.sh@58 -- # uname 00:21:41.373 18:09:50 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:21:41.373 18:09:50 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:21:41.373 18:09:50 -- nvmf/common.sh@63 -- # modprobe ib_core 00:21:41.373 18:09:50 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:21:41.373 18:09:50 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:21:41.373 18:09:50 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:21:41.373 18:09:50 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:21:41.373 18:09:50 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:21:41.373 18:09:50 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:21:41.373 18:09:50 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:21:41.373 18:09:50 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:21:41.373 18:09:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:41.373 18:09:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:41.373 18:09:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:41.373 18:09:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:41.373 18:09:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:41.373 18:09:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:41.373 18:09:50 -- nvmf/common.sh@105 -- # continue 2 00:21:41.373 18:09:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.373 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:41.373 18:09:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:41.373 18:09:50 -- nvmf/common.sh@105 -- # continue 2 00:21:41.632 18:09:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:41.632 18:09:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:21:41.632 18:09:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:41.632 18:09:50 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:21:41.632 18:09:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:21:41.632 18:09:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:21:41.632 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:41.632 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:21:41.632 altname enp24s0f0np0 00:21:41.632 altname ens785f0np0 00:21:41.632 inet 192.168.100.8/24 scope global mlx_0_0 00:21:41.632 valid_lft forever preferred_lft forever 00:21:41.632 18:09:50 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:21:41.632 18:09:50 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:21:41.632 18:09:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:41.632 18:09:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:41.632 18:09:50 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:21:41.632 18:09:50 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:21:41.632 18:09:50 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:21:41.632 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:21:41.632 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:21:41.632 altname enp24s0f1np1 00:21:41.632 altname ens785f1np1 00:21:41.632 inet 192.168.100.9/24 scope global mlx_0_1 00:21:41.632 valid_lft forever preferred_lft forever 00:21:41.632 18:09:50 -- nvmf/common.sh@411 -- # return 0 00:21:41.632 18:09:50 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:21:41.632 18:09:50 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:21:41.632 18:09:50 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:21:41.632 18:09:50 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:21:41.632 18:09:50 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:21:41.632 18:09:50 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:21:41.632 18:09:50 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:21:41.632 18:09:50 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:21:41.632 18:09:50 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:21:41.632 18:09:50 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:21:41.632 18:09:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:41.632 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.632 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:21:41.632 18:09:50 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:21:41.633 18:09:50 -- nvmf/common.sh@105 -- # continue 2 00:21:41.633 18:09:50 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:21:41.633 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.633 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:21:41.633 18:09:50 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:21:41.633 18:09:50 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:21:41.633 18:09:50 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:21:41.633 18:09:50 -- nvmf/common.sh@105 -- # continue 2 00:21:41.633 18:09:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:41.633 18:09:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:21:41.633 18:09:50 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:41.633 18:09:50 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:21:41.633 18:09:50 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:21:41.633 18:09:50 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:21:41.633 18:09:50 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:21:41.633 18:09:50 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:21:41.633 192.168.100.9' 00:21:41.633 18:09:50 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:21:41.633 192.168.100.9' 00:21:41.633 18:09:50 -- nvmf/common.sh@446 -- # head -n 1 00:21:41.633 18:09:50 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:21:41.633 18:09:50 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:21:41.633 192.168.100.9' 00:21:41.633 18:09:50 -- nvmf/common.sh@447 -- # tail -n +2 00:21:41.633 18:09:50 -- nvmf/common.sh@447 -- # head -n 1 00:21:41.633 18:09:50 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:21:41.633 18:09:50 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:21:41.633 18:09:50 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:21:41.633 18:09:50 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:21:41.633 18:09:50 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:21:41.633 18:09:50 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:21:41.633 18:09:50 -- host/auth.sh@78 -- # nvmfappstart -L nvme_auth 00:21:41.633 18:09:50 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:21:41.633 18:09:50 -- common/autotest_common.sh@720 -- # xtrace_disable 00:21:41.633 18:09:50 -- common/autotest_common.sh@10 -- # set +x 00:21:41.633 18:09:50 -- nvmf/common.sh@470 -- # nvmfpid=1044497 00:21:41.633 18:09:50 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -L nvme_auth 00:21:41.633 18:09:50 -- nvmf/common.sh@471 -- # waitforlisten 1044497 00:21:41.633 18:09:50 -- common/autotest_common.sh@827 -- # '[' -z 1044497 ']' 00:21:41.633 18:09:50 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:41.633 18:09:50 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:41.633 18:09:50 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:41.633 18:09:50 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:41.633 18:09:50 -- common/autotest_common.sh@10 -- # set +x 00:21:42.565 18:09:51 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:42.565 18:09:51 -- common/autotest_common.sh@860 -- # return 0 00:21:42.565 18:09:51 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:21:42.565 18:09:51 -- common/autotest_common.sh@726 -- # xtrace_disable 00:21:42.565 18:09:51 -- common/autotest_common.sh@10 -- # set +x 00:21:42.565 18:09:51 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:42.565 18:09:51 -- host/auth.sh@79 -- # trap 'cat /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log; cleanup' SIGINT SIGTERM EXIT 00:21:42.565 18:09:51 -- host/auth.sh@81 -- # gen_key null 32 00:21:42.565 18:09:51 -- host/auth.sh@53 -- # local digest len file key 00:21:42.565 18:09:51 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:42.565 18:09:51 -- host/auth.sh@54 -- # local -A digests 00:21:42.565 18:09:51 -- host/auth.sh@56 -- # digest=null 00:21:42.565 18:09:51 -- host/auth.sh@56 -- # len=32 00:21:42.565 18:09:51 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:21:42.565 18:09:51 -- host/auth.sh@57 -- # key=304feff0d65c1c2b65d29b44972bfd22 00:21:42.565 18:09:51 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:21:42.565 18:09:51 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.m2n 00:21:42.565 18:09:51 -- host/auth.sh@59 -- # format_dhchap_key 304feff0d65c1c2b65d29b44972bfd22 0 00:21:42.565 18:09:51 -- nvmf/common.sh@708 -- # format_key DHHC-1 304feff0d65c1c2b65d29b44972bfd22 0 00:21:42.565 18:09:51 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # key=304feff0d65c1c2b65d29b44972bfd22 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # digest=0 00:21:42.565 18:09:51 -- nvmf/common.sh@694 -- # python - 00:21:42.565 18:09:51 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.m2n 00:21:42.565 18:09:51 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.m2n 00:21:42.565 18:09:51 -- host/auth.sh@81 -- # keys[0]=/tmp/spdk.key-null.m2n 00:21:42.565 18:09:51 -- host/auth.sh@82 -- # gen_key null 48 00:21:42.565 18:09:51 -- host/auth.sh@53 -- # local digest len file key 00:21:42.565 18:09:51 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:42.565 18:09:51 -- host/auth.sh@54 -- # local -A digests 00:21:42.565 18:09:51 -- host/auth.sh@56 -- # digest=null 00:21:42.565 18:09:51 -- host/auth.sh@56 -- # len=48 00:21:42.565 18:09:51 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:21:42.565 18:09:51 -- host/auth.sh@57 -- # key=863de8ee88e0ee4491a8838c4c11f5b46e8fb7c27a82ec31 00:21:42.565 18:09:51 -- host/auth.sh@58 -- # mktemp -t spdk.key-null.XXX 00:21:42.565 18:09:51 -- host/auth.sh@58 -- # file=/tmp/spdk.key-null.dgX 00:21:42.565 18:09:51 -- host/auth.sh@59 -- # format_dhchap_key 863de8ee88e0ee4491a8838c4c11f5b46e8fb7c27a82ec31 0 00:21:42.565 18:09:51 -- nvmf/common.sh@708 -- # format_key DHHC-1 863de8ee88e0ee4491a8838c4c11f5b46e8fb7c27a82ec31 0 00:21:42.565 18:09:51 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # key=863de8ee88e0ee4491a8838c4c11f5b46e8fb7c27a82ec31 00:21:42.565 18:09:51 -- nvmf/common.sh@693 -- # digest=0 00:21:42.566 18:09:51 -- nvmf/common.sh@694 -- # python - 00:21:42.566 18:09:51 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-null.dgX 00:21:42.566 18:09:51 -- host/auth.sh@62 -- # echo /tmp/spdk.key-null.dgX 00:21:42.566 18:09:51 -- host/auth.sh@82 -- # keys[1]=/tmp/spdk.key-null.dgX 00:21:42.566 18:09:51 -- host/auth.sh@83 -- # gen_key sha256 32 00:21:42.566 18:09:51 -- host/auth.sh@53 -- # local digest len file key 00:21:42.566 18:09:51 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:42.566 18:09:51 -- host/auth.sh@54 -- # local -A digests 00:21:42.566 18:09:51 -- host/auth.sh@56 -- # digest=sha256 00:21:42.566 18:09:51 -- host/auth.sh@56 -- # len=32 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # xxd -p -c0 -l 16 /dev/urandom 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # key=828b09a2bb5bf66cd8540b35d531fcb9 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha256.XXX 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha256.9kA 00:21:42.824 18:09:51 -- host/auth.sh@59 -- # format_dhchap_key 828b09a2bb5bf66cd8540b35d531fcb9 1 00:21:42.824 18:09:51 -- nvmf/common.sh@708 -- # format_key DHHC-1 828b09a2bb5bf66cd8540b35d531fcb9 1 00:21:42.824 18:09:51 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # key=828b09a2bb5bf66cd8540b35d531fcb9 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # digest=1 00:21:42.824 18:09:51 -- nvmf/common.sh@694 -- # python - 00:21:42.824 18:09:51 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha256.9kA 00:21:42.824 18:09:51 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha256.9kA 00:21:42.824 18:09:51 -- host/auth.sh@83 -- # keys[2]=/tmp/spdk.key-sha256.9kA 00:21:42.824 18:09:51 -- host/auth.sh@84 -- # gen_key sha384 48 00:21:42.824 18:09:51 -- host/auth.sh@53 -- # local digest len file key 00:21:42.824 18:09:51 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:42.824 18:09:51 -- host/auth.sh@54 -- # local -A digests 00:21:42.824 18:09:51 -- host/auth.sh@56 -- # digest=sha384 00:21:42.824 18:09:51 -- host/auth.sh@56 -- # len=48 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # xxd -p -c0 -l 24 /dev/urandom 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # key=34c72e013f25755e428e8b576c812c27d1d72fcca388ca6b 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha384.XXX 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha384.Yqb 00:21:42.824 18:09:51 -- host/auth.sh@59 -- # format_dhchap_key 34c72e013f25755e428e8b576c812c27d1d72fcca388ca6b 2 00:21:42.824 18:09:51 -- nvmf/common.sh@708 -- # format_key DHHC-1 34c72e013f25755e428e8b576c812c27d1d72fcca388ca6b 2 00:21:42.824 18:09:51 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # key=34c72e013f25755e428e8b576c812c27d1d72fcca388ca6b 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # digest=2 00:21:42.824 18:09:51 -- nvmf/common.sh@694 -- # python - 00:21:42.824 18:09:51 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha384.Yqb 00:21:42.824 18:09:51 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha384.Yqb 00:21:42.824 18:09:51 -- host/auth.sh@84 -- # keys[3]=/tmp/spdk.key-sha384.Yqb 00:21:42.824 18:09:51 -- host/auth.sh@85 -- # gen_key sha512 64 00:21:42.824 18:09:51 -- host/auth.sh@53 -- # local digest len file key 00:21:42.824 18:09:51 -- host/auth.sh@54 -- # digests=(['null']='0' ['sha256']='1' ['sha384']='2' ['sha512']='3') 00:21:42.824 18:09:51 -- host/auth.sh@54 -- # local -A digests 00:21:42.824 18:09:51 -- host/auth.sh@56 -- # digest=sha512 00:21:42.824 18:09:51 -- host/auth.sh@56 -- # len=64 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # xxd -p -c0 -l 32 /dev/urandom 00:21:42.824 18:09:51 -- host/auth.sh@57 -- # key=976cd6d9db121fb1dd49666865d89352a57986a3539c3754a12681783b924269 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # mktemp -t spdk.key-sha512.XXX 00:21:42.824 18:09:51 -- host/auth.sh@58 -- # file=/tmp/spdk.key-sha512.36b 00:21:42.824 18:09:51 -- host/auth.sh@59 -- # format_dhchap_key 976cd6d9db121fb1dd49666865d89352a57986a3539c3754a12681783b924269 3 00:21:42.824 18:09:51 -- nvmf/common.sh@708 -- # format_key DHHC-1 976cd6d9db121fb1dd49666865d89352a57986a3539c3754a12681783b924269 3 00:21:42.824 18:09:51 -- nvmf/common.sh@691 -- # local prefix key digest 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # prefix=DHHC-1 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # key=976cd6d9db121fb1dd49666865d89352a57986a3539c3754a12681783b924269 00:21:42.824 18:09:51 -- nvmf/common.sh@693 -- # digest=3 00:21:42.824 18:09:51 -- nvmf/common.sh@694 -- # python - 00:21:42.824 18:09:51 -- host/auth.sh@60 -- # chmod 0600 /tmp/spdk.key-sha512.36b 00:21:42.824 18:09:51 -- host/auth.sh@62 -- # echo /tmp/spdk.key-sha512.36b 00:21:42.824 18:09:51 -- host/auth.sh@85 -- # keys[4]=/tmp/spdk.key-sha512.36b 00:21:42.824 18:09:51 -- host/auth.sh@87 -- # waitforlisten 1044497 00:21:42.824 18:09:51 -- common/autotest_common.sh@827 -- # '[' -z 1044497 ']' 00:21:42.824 18:09:51 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:42.824 18:09:51 -- common/autotest_common.sh@832 -- # local max_retries=100 00:21:42.824 18:09:51 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:42.824 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:42.824 18:09:51 -- common/autotest_common.sh@836 -- # xtrace_disable 00:21:42.824 18:09:51 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:21:43.094 18:09:52 -- common/autotest_common.sh@860 -- # return 0 00:21:43.094 18:09:52 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:43.094 18:09:52 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key0 /tmp/spdk.key-null.m2n 00:21:43.094 18:09:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:43.094 18:09:52 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:43.094 18:09:52 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:43.094 18:09:52 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key1 /tmp/spdk.key-null.dgX 00:21:43.094 18:09:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:43.094 18:09:52 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:43.094 18:09:52 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:43.094 18:09:52 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key2 /tmp/spdk.key-sha256.9kA 00:21:43.094 18:09:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:43.094 18:09:52 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:43.094 18:09:52 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:43.094 18:09:52 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key3 /tmp/spdk.key-sha384.Yqb 00:21:43.094 18:09:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:43.094 18:09:52 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:43.094 18:09:52 -- host/auth.sh@88 -- # for i in "${!keys[@]}" 00:21:43.094 18:09:52 -- host/auth.sh@89 -- # rpc_cmd keyring_file_add_key key4 /tmp/spdk.key-sha512.36b 00:21:43.094 18:09:52 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:43.094 18:09:52 -- common/autotest_common.sh@10 -- # set +x 00:21:43.094 18:09:52 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:43.095 18:09:52 -- host/auth.sh@92 -- # nvmet_auth_init 00:21:43.095 18:09:52 -- host/auth.sh@35 -- # get_main_ns_ip 00:21:43.095 18:09:52 -- nvmf/common.sh@717 -- # local ip 00:21:43.095 18:09:52 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:43.095 18:09:52 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:43.095 18:09:52 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:43.095 18:09:52 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:43.095 18:09:52 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:43.095 18:09:52 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:43.095 18:09:52 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:43.095 18:09:52 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:43.095 18:09:52 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:43.095 18:09:52 -- host/auth.sh@35 -- # configure_kernel_target nqn.2024-02.io.spdk:cnode0 192.168.100.8 00:21:43.095 18:09:52 -- nvmf/common.sh@621 -- # local kernel_name=nqn.2024-02.io.spdk:cnode0 kernel_target_ip=192.168.100.8 00:21:43.095 18:09:52 -- nvmf/common.sh@623 -- # nvmet=/sys/kernel/config/nvmet 00:21:43.095 18:09:52 -- nvmf/common.sh@624 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:43.095 18:09:52 -- nvmf/common.sh@625 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:21:43.095 18:09:52 -- nvmf/common.sh@626 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:21:43.095 18:09:52 -- nvmf/common.sh@628 -- # local block nvme 00:21:43.095 18:09:52 -- nvmf/common.sh@630 -- # [[ ! -e /sys/module/nvmet ]] 00:21:43.095 18:09:52 -- nvmf/common.sh@631 -- # modprobe nvmet 00:21:43.095 18:09:52 -- nvmf/common.sh@634 -- # [[ -e /sys/kernel/config/nvmet ]] 00:21:43.095 18:09:52 -- nvmf/common.sh@636 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh reset 00:21:46.376 Waiting for block devices as requested 00:21:46.376 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:21:46.376 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:46.376 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:46.376 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:46.376 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:46.376 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:46.633 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:46.633 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:46.633 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:46.891 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:21:46.891 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:21:46.891 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:21:47.149 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:21:47.149 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:21:47.149 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:21:47.407 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:21:47.407 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:21:48.342 18:09:57 -- nvmf/common.sh@639 -- # for block in /sys/block/nvme* 00:21:48.342 18:09:57 -- nvmf/common.sh@640 -- # [[ -e /sys/block/nvme0n1 ]] 00:21:48.342 18:09:57 -- nvmf/common.sh@641 -- # is_block_zoned nvme0n1 00:21:48.342 18:09:57 -- common/autotest_common.sh@1658 -- # local device=nvme0n1 00:21:48.342 18:09:57 -- common/autotest_common.sh@1660 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:21:48.342 18:09:57 -- common/autotest_common.sh@1661 -- # [[ none != none ]] 00:21:48.342 18:09:57 -- nvmf/common.sh@642 -- # block_in_use nvme0n1 00:21:48.342 18:09:57 -- scripts/common.sh@378 -- # local block=nvme0n1 pt 00:21:48.342 18:09:57 -- scripts/common.sh@387 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:21:48.342 No valid GPT data, bailing 00:21:48.342 18:09:57 -- scripts/common.sh@391 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:21:48.342 18:09:57 -- scripts/common.sh@391 -- # pt= 00:21:48.342 18:09:57 -- scripts/common.sh@392 -- # return 1 00:21:48.342 18:09:57 -- nvmf/common.sh@642 -- # nvme=/dev/nvme0n1 00:21:48.342 18:09:57 -- nvmf/common.sh@645 -- # [[ -b /dev/nvme0n1 ]] 00:21:48.342 18:09:57 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:21:48.342 18:09:57 -- nvmf/common.sh@648 -- # mkdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:21:48.342 18:09:57 -- nvmf/common.sh@649 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:21:48.342 18:09:57 -- nvmf/common.sh@654 -- # echo SPDK-nqn.2024-02.io.spdk:cnode0 00:21:48.342 18:09:57 -- nvmf/common.sh@656 -- # echo 1 00:21:48.342 18:09:57 -- nvmf/common.sh@657 -- # echo /dev/nvme0n1 00:21:48.342 18:09:57 -- nvmf/common.sh@658 -- # echo 1 00:21:48.342 18:09:57 -- nvmf/common.sh@660 -- # echo 192.168.100.8 00:21:48.342 18:09:57 -- nvmf/common.sh@661 -- # echo rdma 00:21:48.342 18:09:57 -- nvmf/common.sh@662 -- # echo 4420 00:21:48.342 18:09:57 -- nvmf/common.sh@663 -- # echo ipv4 00:21:48.342 18:09:57 -- nvmf/common.sh@666 -- # ln -s /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 /sys/kernel/config/nvmet/ports/1/subsystems/ 00:21:48.342 18:09:57 -- nvmf/common.sh@669 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 --hostid=0049fda6-1adc-e711-906e-0017a4403562 -a 192.168.100.8 -t rdma -s 4420 00:21:48.342 00:21:48.342 Discovery Log Number of Records 2, Generation counter 2 00:21:48.342 =====Discovery Log Entry 0====== 00:21:48.342 trtype: rdma 00:21:48.342 adrfam: ipv4 00:21:48.342 subtype: current discovery subsystem 00:21:48.342 treq: not specified, sq flow control disable supported 00:21:48.342 portid: 1 00:21:48.342 trsvcid: 4420 00:21:48.342 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:21:48.342 traddr: 192.168.100.8 00:21:48.342 eflags: none 00:21:48.342 rdma_prtype: not specified 00:21:48.342 rdma_qptype: connected 00:21:48.342 rdma_cms: rdma-cm 00:21:48.342 rdma_pkey: 0x0000 00:21:48.342 =====Discovery Log Entry 1====== 00:21:48.342 trtype: rdma 00:21:48.342 adrfam: ipv4 00:21:48.342 subtype: nvme subsystem 00:21:48.342 treq: not specified, sq flow control disable supported 00:21:48.342 portid: 1 00:21:48.342 trsvcid: 4420 00:21:48.342 subnqn: nqn.2024-02.io.spdk:cnode0 00:21:48.342 traddr: 192.168.100.8 00:21:48.342 eflags: none 00:21:48.342 rdma_prtype: not specified 00:21:48.342 rdma_qptype: connected 00:21:48.342 rdma_cms: rdma-cm 00:21:48.342 rdma_pkey: 0x0000 00:21:48.342 18:09:57 -- host/auth.sh@36 -- # mkdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:21:48.342 18:09:57 -- host/auth.sh@37 -- # echo 0 00:21:48.342 18:09:57 -- host/auth.sh@38 -- # ln -s /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:21:48.342 18:09:57 -- host/auth.sh@95 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:21:48.343 18:09:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:48.343 18:09:57 -- host/auth.sh@44 -- # digest=sha256 00:21:48.343 18:09:57 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:48.343 18:09:57 -- host/auth.sh@44 -- # keyid=1 00:21:48.343 18:09:57 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:48.343 18:09:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:48.343 18:09:57 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:48.343 18:09:57 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:48.343 18:09:57 -- host/auth.sh@100 -- # IFS=, 00:21:48.343 18:09:57 -- host/auth.sh@101 -- # printf %s sha256,sha384,sha512 00:21:48.343 18:09:57 -- host/auth.sh@100 -- # IFS=, 00:21:48.343 18:09:57 -- host/auth.sh@101 -- # printf %s ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:48.343 18:09:57 -- host/auth.sh@100 -- # connect_authenticate sha256,sha384,sha512 ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 1 00:21:48.343 18:09:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:48.343 18:09:57 -- host/auth.sh@68 -- # digest=sha256,sha384,sha512 00:21:48.343 18:09:57 -- host/auth.sh@68 -- # dhgroup=ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:48.343 18:09:57 -- host/auth.sh@68 -- # keyid=1 00:21:48.343 18:09:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256,sha384,sha512 --dhchap-dhgroups ffdhe2048,ffdhe3072,ffdhe4096,ffdhe6144,ffdhe8192 00:21:48.343 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.343 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.343 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.343 18:09:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:48.343 18:09:57 -- nvmf/common.sh@717 -- # local ip 00:21:48.343 18:09:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:48.343 18:09:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:48.343 18:09:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:48.343 18:09:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:48.343 18:09:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:48.343 18:09:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:48.343 18:09:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:48.343 18:09:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:48.343 18:09:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:48.343 18:09:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:48.343 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.343 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.601 nvme0n1 00:21:48.601 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.601 18:09:57 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:48.601 18:09:57 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:48.601 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.601 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.601 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.601 18:09:57 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:48.601 18:09:57 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:48.601 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.601 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.859 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.859 18:09:57 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:21:48.859 18:09:57 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:48.859 18:09:57 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:48.859 18:09:57 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 0 00:21:48.859 18:09:57 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:48.859 18:09:57 -- host/auth.sh@44 -- # digest=sha256 00:21:48.859 18:09:57 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:48.859 18:09:57 -- host/auth.sh@44 -- # keyid=0 00:21:48.859 18:09:57 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:48.859 18:09:57 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:48.859 18:09:57 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:48.859 18:09:57 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:48.859 18:09:57 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 0 00:21:48.859 18:09:57 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:48.859 18:09:57 -- host/auth.sh@68 -- # digest=sha256 00:21:48.859 18:09:57 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:48.859 18:09:57 -- host/auth.sh@68 -- # keyid=0 00:21:48.859 18:09:57 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:48.859 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.859 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.859 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.859 18:09:57 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:48.859 18:09:57 -- nvmf/common.sh@717 -- # local ip 00:21:48.859 18:09:57 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:48.859 18:09:57 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:48.859 18:09:57 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:48.859 18:09:57 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:48.859 18:09:57 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:48.859 18:09:57 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:48.859 18:09:57 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:48.859 18:09:57 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:48.859 18:09:57 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:48.860 18:09:57 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:48.860 18:09:57 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.860 18:09:57 -- common/autotest_common.sh@10 -- # set +x 00:21:48.860 nvme0n1 00:21:48.860 18:09:57 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.860 18:09:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:48.860 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.860 18:09:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:48.860 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:48.860 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:48.860 18:09:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:48.860 18:09:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:48.860 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:48.860 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.118 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.118 18:09:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.118 18:09:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:21:49.118 18:09:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.118 18:09:58 -- host/auth.sh@44 -- # digest=sha256 00:21:49.118 18:09:58 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.118 18:09:58 -- host/auth.sh@44 -- # keyid=1 00:21:49.118 18:09:58 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:49.118 18:09:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:49.118 18:09:58 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.118 18:09:58 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:49.118 18:09:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 1 00:21:49.118 18:09:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.118 18:09:58 -- host/auth.sh@68 -- # digest=sha256 00:21:49.118 18:09:58 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.118 18:09:58 -- host/auth.sh@68 -- # keyid=1 00:21:49.118 18:09:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:49.118 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.118 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.118 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.118 18:09:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.118 18:09:58 -- nvmf/common.sh@717 -- # local ip 00:21:49.118 18:09:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.118 18:09:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.118 18:09:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.118 18:09:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.118 18:09:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.118 18:09:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.118 18:09:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.118 18:09:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.118 18:09:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.118 18:09:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:49.118 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.118 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.118 nvme0n1 00:21:49.118 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.118 18:09:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.118 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.118 18:09:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.118 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.118 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.118 18:09:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:49.118 18:09:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:49.118 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.412 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.412 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.412 18:09:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.412 18:09:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 2 00:21:49.412 18:09:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.412 18:09:58 -- host/auth.sh@44 -- # digest=sha256 00:21:49.412 18:09:58 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.412 18:09:58 -- host/auth.sh@44 -- # keyid=2 00:21:49.412 18:09:58 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:49.412 18:09:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:49.412 18:09:58 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.412 18:09:58 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:49.412 18:09:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 2 00:21:49.412 18:09:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.412 18:09:58 -- host/auth.sh@68 -- # digest=sha256 00:21:49.412 18:09:58 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.412 18:09:58 -- host/auth.sh@68 -- # keyid=2 00:21:49.412 18:09:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:49.412 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.412 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.412 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.412 18:09:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.412 18:09:58 -- nvmf/common.sh@717 -- # local ip 00:21:49.412 18:09:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.412 18:09:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.412 18:09:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.412 18:09:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.412 18:09:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.412 18:09:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.412 18:09:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.412 18:09:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.412 18:09:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.412 18:09:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:49.412 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.412 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.412 nvme0n1 00:21:49.412 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.412 18:09:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.412 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.412 18:09:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.412 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.412 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.412 18:09:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:49.412 18:09:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:49.412 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.412 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.674 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.675 18:09:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.675 18:09:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 3 00:21:49.675 18:09:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.675 18:09:58 -- host/auth.sh@44 -- # digest=sha256 00:21:49.675 18:09:58 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.675 18:09:58 -- host/auth.sh@44 -- # keyid=3 00:21:49.675 18:09:58 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:49.675 18:09:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:49.675 18:09:58 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.675 18:09:58 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:49.675 18:09:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 3 00:21:49.675 18:09:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.675 18:09:58 -- host/auth.sh@68 -- # digest=sha256 00:21:49.675 18:09:58 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.675 18:09:58 -- host/auth.sh@68 -- # keyid=3 00:21:49.675 18:09:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:49.675 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.675 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.675 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.675 18:09:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.675 18:09:58 -- nvmf/common.sh@717 -- # local ip 00:21:49.675 18:09:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.675 18:09:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.675 18:09:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.675 18:09:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.675 18:09:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.675 18:09:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.675 18:09:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.675 18:09:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.675 18:09:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.675 18:09:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:49.675 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.675 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.675 nvme0n1 00:21:49.675 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.675 18:09:58 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.675 18:09:58 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.675 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.675 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.675 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.675 18:09:58 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:49.675 18:09:58 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:49.675 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.675 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.933 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.933 18:09:58 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:49.933 18:09:58 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe2048 4 00:21:49.933 18:09:58 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:49.933 18:09:58 -- host/auth.sh@44 -- # digest=sha256 00:21:49.933 18:09:58 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:49.933 18:09:58 -- host/auth.sh@44 -- # keyid=4 00:21:49.933 18:09:58 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:49.933 18:09:58 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:49.933 18:09:58 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:49.933 18:09:58 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:49.933 18:09:58 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe2048 4 00:21:49.933 18:09:58 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:49.933 18:09:58 -- host/auth.sh@68 -- # digest=sha256 00:21:49.933 18:09:58 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:49.933 18:09:58 -- host/auth.sh@68 -- # keyid=4 00:21:49.933 18:09:58 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:21:49.933 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.933 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.933 18:09:58 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.933 18:09:58 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:49.933 18:09:58 -- nvmf/common.sh@717 -- # local ip 00:21:49.933 18:09:58 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:49.933 18:09:58 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:49.933 18:09:58 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:49.933 18:09:58 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:49.933 18:09:58 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:49.933 18:09:58 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:49.933 18:09:58 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:49.933 18:09:58 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:49.933 18:09:58 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:49.933 18:09:58 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:49.933 18:09:58 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.933 18:09:58 -- common/autotest_common.sh@10 -- # set +x 00:21:49.933 nvme0n1 00:21:49.933 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:49.933 18:09:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:49.933 18:09:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:49.933 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:49.933 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:49.933 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.192 18:09:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.192 18:09:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.192 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.192 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.192 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.192 18:09:59 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:50.192 18:09:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.192 18:09:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 0 00:21:50.192 18:09:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.192 18:09:59 -- host/auth.sh@44 -- # digest=sha256 00:21:50.192 18:09:59 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:50.192 18:09:59 -- host/auth.sh@44 -- # keyid=0 00:21:50.192 18:09:59 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:50.192 18:09:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:50.192 18:09:59 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:50.192 18:09:59 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:50.192 18:09:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 0 00:21:50.192 18:09:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.192 18:09:59 -- host/auth.sh@68 -- # digest=sha256 00:21:50.192 18:09:59 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:50.192 18:09:59 -- host/auth.sh@68 -- # keyid=0 00:21:50.192 18:09:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:50.192 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.192 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.192 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.192 18:09:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.192 18:09:59 -- nvmf/common.sh@717 -- # local ip 00:21:50.192 18:09:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.192 18:09:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.192 18:09:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.192 18:09:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.192 18:09:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.192 18:09:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.192 18:09:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.192 18:09:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.192 18:09:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.192 18:09:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:50.192 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.192 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.192 nvme0n1 00:21:50.192 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.192 18:09:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.192 18:09:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.192 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.192 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.451 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.451 18:09:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.451 18:09:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.451 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.451 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.451 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.451 18:09:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.451 18:09:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 1 00:21:50.451 18:09:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.451 18:09:59 -- host/auth.sh@44 -- # digest=sha256 00:21:50.451 18:09:59 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:50.451 18:09:59 -- host/auth.sh@44 -- # keyid=1 00:21:50.451 18:09:59 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:50.451 18:09:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:50.451 18:09:59 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:50.451 18:09:59 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:50.451 18:09:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 1 00:21:50.451 18:09:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.451 18:09:59 -- host/auth.sh@68 -- # digest=sha256 00:21:50.451 18:09:59 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:50.451 18:09:59 -- host/auth.sh@68 -- # keyid=1 00:21:50.451 18:09:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:50.451 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.451 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.451 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.451 18:09:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.451 18:09:59 -- nvmf/common.sh@717 -- # local ip 00:21:50.451 18:09:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.451 18:09:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.451 18:09:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.451 18:09:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.451 18:09:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.451 18:09:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.451 18:09:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.451 18:09:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.451 18:09:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.451 18:09:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:50.451 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.451 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.710 nvme0n1 00:21:50.710 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.710 18:09:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.710 18:09:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.710 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.710 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.710 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.710 18:09:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.710 18:09:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.710 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.710 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.710 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.710 18:09:59 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.710 18:09:59 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 2 00:21:50.710 18:09:59 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.710 18:09:59 -- host/auth.sh@44 -- # digest=sha256 00:21:50.710 18:09:59 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:50.710 18:09:59 -- host/auth.sh@44 -- # keyid=2 00:21:50.710 18:09:59 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:50.710 18:09:59 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:50.711 18:09:59 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:50.711 18:09:59 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:50.711 18:09:59 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 2 00:21:50.711 18:09:59 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.711 18:09:59 -- host/auth.sh@68 -- # digest=sha256 00:21:50.711 18:09:59 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:50.711 18:09:59 -- host/auth.sh@68 -- # keyid=2 00:21:50.711 18:09:59 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:50.711 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.711 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.711 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.711 18:09:59 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.711 18:09:59 -- nvmf/common.sh@717 -- # local ip 00:21:50.711 18:09:59 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.711 18:09:59 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.711 18:09:59 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.711 18:09:59 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.711 18:09:59 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.711 18:09:59 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.711 18:09:59 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.711 18:09:59 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.711 18:09:59 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.711 18:09:59 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:50.711 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.711 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.969 nvme0n1 00:21:50.969 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.969 18:09:59 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:50.969 18:09:59 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:50.969 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.969 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.969 18:09:59 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.969 18:09:59 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:50.969 18:09:59 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:50.969 18:09:59 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.969 18:09:59 -- common/autotest_common.sh@10 -- # set +x 00:21:50.969 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.969 18:10:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:50.969 18:10:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 3 00:21:50.969 18:10:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:50.969 18:10:00 -- host/auth.sh@44 -- # digest=sha256 00:21:50.969 18:10:00 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:50.969 18:10:00 -- host/auth.sh@44 -- # keyid=3 00:21:50.969 18:10:00 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:50.970 18:10:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:50.970 18:10:00 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:50.970 18:10:00 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:50.970 18:10:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 3 00:21:50.970 18:10:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:50.970 18:10:00 -- host/auth.sh@68 -- # digest=sha256 00:21:50.970 18:10:00 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:50.970 18:10:00 -- host/auth.sh@68 -- # keyid=3 00:21:50.970 18:10:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:50.970 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.970 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:50.970 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:50.970 18:10:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:50.970 18:10:00 -- nvmf/common.sh@717 -- # local ip 00:21:50.970 18:10:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:50.970 18:10:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:50.970 18:10:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:50.970 18:10:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:50.970 18:10:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:50.970 18:10:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:50.970 18:10:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:50.970 18:10:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:50.970 18:10:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:50.970 18:10:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:50.970 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:50.970 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.228 nvme0n1 00:21:51.229 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.229 18:10:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.229 18:10:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.229 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.229 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.229 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.229 18:10:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.229 18:10:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.229 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.229 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.229 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.229 18:10:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.229 18:10:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe3072 4 00:21:51.229 18:10:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.229 18:10:00 -- host/auth.sh@44 -- # digest=sha256 00:21:51.229 18:10:00 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:21:51.229 18:10:00 -- host/auth.sh@44 -- # keyid=4 00:21:51.229 18:10:00 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:51.229 18:10:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:51.229 18:10:00 -- host/auth.sh@48 -- # echo ffdhe3072 00:21:51.229 18:10:00 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:51.229 18:10:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe3072 4 00:21:51.229 18:10:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.229 18:10:00 -- host/auth.sh@68 -- # digest=sha256 00:21:51.229 18:10:00 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:21:51.229 18:10:00 -- host/auth.sh@68 -- # keyid=4 00:21:51.229 18:10:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe3072 00:21:51.229 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.229 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.229 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.229 18:10:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.229 18:10:00 -- nvmf/common.sh@717 -- # local ip 00:21:51.229 18:10:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.229 18:10:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.229 18:10:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.229 18:10:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.229 18:10:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.229 18:10:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.229 18:10:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.229 18:10:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.229 18:10:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.229 18:10:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:51.229 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.229 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.487 nvme0n1 00:21:51.487 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.487 18:10:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.487 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.487 18:10:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.487 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.487 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.487 18:10:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.487 18:10:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.487 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.487 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.487 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.487 18:10:00 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:51.487 18:10:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.487 18:10:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 0 00:21:51.487 18:10:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.487 18:10:00 -- host/auth.sh@44 -- # digest=sha256 00:21:51.487 18:10:00 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:51.487 18:10:00 -- host/auth.sh@44 -- # keyid=0 00:21:51.487 18:10:00 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:51.487 18:10:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:51.487 18:10:00 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:51.488 18:10:00 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:51.488 18:10:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 0 00:21:51.488 18:10:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.488 18:10:00 -- host/auth.sh@68 -- # digest=sha256 00:21:51.488 18:10:00 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:51.488 18:10:00 -- host/auth.sh@68 -- # keyid=0 00:21:51.488 18:10:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:51.488 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.488 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.488 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.488 18:10:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.488 18:10:00 -- nvmf/common.sh@717 -- # local ip 00:21:51.488 18:10:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.488 18:10:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.488 18:10:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.488 18:10:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.488 18:10:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.488 18:10:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.488 18:10:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.488 18:10:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.488 18:10:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.488 18:10:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:51.488 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.488 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 nvme0n1 00:21:51.746 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.746 18:10:00 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:51.746 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.746 18:10:00 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:51.746 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.746 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.746 18:10:00 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:51.747 18:10:00 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:51.747 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.747 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.747 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.747 18:10:00 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:51.747 18:10:00 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 1 00:21:51.747 18:10:00 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:51.747 18:10:00 -- host/auth.sh@44 -- # digest=sha256 00:21:51.747 18:10:00 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:51.747 18:10:00 -- host/auth.sh@44 -- # keyid=1 00:21:51.747 18:10:00 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:51.747 18:10:00 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:51.747 18:10:00 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:51.747 18:10:00 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:51.747 18:10:00 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 1 00:21:51.747 18:10:00 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:51.747 18:10:00 -- host/auth.sh@68 -- # digest=sha256 00:21:51.747 18:10:00 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:51.747 18:10:00 -- host/auth.sh@68 -- # keyid=1 00:21:51.747 18:10:00 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:51.747 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.747 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:51.747 18:10:00 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:51.747 18:10:00 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:51.747 18:10:00 -- nvmf/common.sh@717 -- # local ip 00:21:51.747 18:10:00 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:51.747 18:10:00 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:51.747 18:10:00 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:51.747 18:10:00 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:51.747 18:10:00 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:51.747 18:10:00 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:51.747 18:10:00 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:51.747 18:10:00 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:51.747 18:10:00 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:51.747 18:10:00 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:51.747 18:10:00 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:51.747 18:10:00 -- common/autotest_common.sh@10 -- # set +x 00:21:52.004 nvme0n1 00:21:52.004 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.004 18:10:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.004 18:10:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.004 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.004 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.262 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.262 18:10:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.262 18:10:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.262 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.262 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.262 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.262 18:10:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.263 18:10:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 2 00:21:52.263 18:10:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.263 18:10:01 -- host/auth.sh@44 -- # digest=sha256 00:21:52.263 18:10:01 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.263 18:10:01 -- host/auth.sh@44 -- # keyid=2 00:21:52.263 18:10:01 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:52.263 18:10:01 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:52.263 18:10:01 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.263 18:10:01 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:52.263 18:10:01 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 2 00:21:52.263 18:10:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.263 18:10:01 -- host/auth.sh@68 -- # digest=sha256 00:21:52.263 18:10:01 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.263 18:10:01 -- host/auth.sh@68 -- # keyid=2 00:21:52.263 18:10:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:52.263 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.263 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.263 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.263 18:10:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.263 18:10:01 -- nvmf/common.sh@717 -- # local ip 00:21:52.263 18:10:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.263 18:10:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.263 18:10:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.263 18:10:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.263 18:10:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.263 18:10:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.263 18:10:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.263 18:10:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.263 18:10:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.263 18:10:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:52.263 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.263 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.521 nvme0n1 00:21:52.521 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.521 18:10:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.521 18:10:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.521 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.521 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.521 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.521 18:10:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.521 18:10:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.521 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.521 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.521 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.521 18:10:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.521 18:10:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 3 00:21:52.521 18:10:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.521 18:10:01 -- host/auth.sh@44 -- # digest=sha256 00:21:52.521 18:10:01 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.521 18:10:01 -- host/auth.sh@44 -- # keyid=3 00:21:52.521 18:10:01 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:52.521 18:10:01 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:52.521 18:10:01 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.521 18:10:01 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:52.521 18:10:01 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 3 00:21:52.521 18:10:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.521 18:10:01 -- host/auth.sh@68 -- # digest=sha256 00:21:52.521 18:10:01 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.521 18:10:01 -- host/auth.sh@68 -- # keyid=3 00:21:52.521 18:10:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:52.521 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.521 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.521 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.521 18:10:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.521 18:10:01 -- nvmf/common.sh@717 -- # local ip 00:21:52.521 18:10:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.521 18:10:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.521 18:10:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.521 18:10:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.521 18:10:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.521 18:10:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.521 18:10:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.521 18:10:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.521 18:10:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.521 18:10:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:52.521 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.521 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.780 nvme0n1 00:21:52.780 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.780 18:10:01 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:52.780 18:10:01 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:52.780 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.780 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.780 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.780 18:10:01 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:52.780 18:10:01 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:52.780 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.780 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.780 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.780 18:10:01 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:52.780 18:10:01 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe4096 4 00:21:52.780 18:10:01 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:52.780 18:10:01 -- host/auth.sh@44 -- # digest=sha256 00:21:52.780 18:10:01 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:21:52.780 18:10:01 -- host/auth.sh@44 -- # keyid=4 00:21:52.780 18:10:01 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:52.780 18:10:01 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:52.780 18:10:01 -- host/auth.sh@48 -- # echo ffdhe4096 00:21:52.780 18:10:01 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:52.780 18:10:01 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe4096 4 00:21:52.780 18:10:01 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:52.780 18:10:01 -- host/auth.sh@68 -- # digest=sha256 00:21:52.780 18:10:01 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:21:52.780 18:10:01 -- host/auth.sh@68 -- # keyid=4 00:21:52.780 18:10:01 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe4096 00:21:52.780 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.780 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:52.780 18:10:01 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:52.780 18:10:01 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:52.780 18:10:01 -- nvmf/common.sh@717 -- # local ip 00:21:52.780 18:10:01 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:52.780 18:10:01 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:52.780 18:10:01 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:52.780 18:10:01 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:52.780 18:10:01 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:52.780 18:10:01 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:52.780 18:10:01 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:52.780 18:10:01 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:52.780 18:10:01 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:52.780 18:10:01 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:52.780 18:10:01 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:52.780 18:10:01 -- common/autotest_common.sh@10 -- # set +x 00:21:53.038 nvme0n1 00:21:53.038 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.038 18:10:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:53.038 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.039 18:10:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:53.039 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.039 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.297 18:10:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:53.297 18:10:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:53.297 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.297 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.297 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.297 18:10:02 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:53.297 18:10:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:53.297 18:10:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 0 00:21:53.297 18:10:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:53.297 18:10:02 -- host/auth.sh@44 -- # digest=sha256 00:21:53.297 18:10:02 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:53.297 18:10:02 -- host/auth.sh@44 -- # keyid=0 00:21:53.297 18:10:02 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:53.297 18:10:02 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:53.297 18:10:02 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:53.297 18:10:02 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:53.297 18:10:02 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 0 00:21:53.297 18:10:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:53.297 18:10:02 -- host/auth.sh@68 -- # digest=sha256 00:21:53.297 18:10:02 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:53.297 18:10:02 -- host/auth.sh@68 -- # keyid=0 00:21:53.297 18:10:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:53.297 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.297 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.297 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.297 18:10:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:53.297 18:10:02 -- nvmf/common.sh@717 -- # local ip 00:21:53.297 18:10:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:53.297 18:10:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:53.297 18:10:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:53.297 18:10:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:53.297 18:10:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:53.297 18:10:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:53.297 18:10:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:53.297 18:10:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:53.297 18:10:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:53.297 18:10:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:53.297 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.297 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.556 nvme0n1 00:21:53.556 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.556 18:10:02 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:53.556 18:10:02 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:53.556 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.556 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.556 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.556 18:10:02 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:53.556 18:10:02 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:53.556 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.556 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.556 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.556 18:10:02 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:53.556 18:10:02 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 1 00:21:53.556 18:10:02 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:53.556 18:10:02 -- host/auth.sh@44 -- # digest=sha256 00:21:53.556 18:10:02 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:53.556 18:10:02 -- host/auth.sh@44 -- # keyid=1 00:21:53.556 18:10:02 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:53.556 18:10:02 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:53.556 18:10:02 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:53.556 18:10:02 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:53.556 18:10:02 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 1 00:21:53.556 18:10:02 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:53.556 18:10:02 -- host/auth.sh@68 -- # digest=sha256 00:21:53.556 18:10:02 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:53.556 18:10:02 -- host/auth.sh@68 -- # keyid=1 00:21:53.556 18:10:02 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:53.556 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.556 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:53.556 18:10:02 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:53.556 18:10:02 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:53.556 18:10:02 -- nvmf/common.sh@717 -- # local ip 00:21:53.556 18:10:02 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:53.556 18:10:02 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:53.556 18:10:02 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:53.556 18:10:02 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:53.556 18:10:02 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:53.556 18:10:02 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:53.556 18:10:02 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:53.556 18:10:02 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:53.556 18:10:02 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:53.556 18:10:02 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:53.556 18:10:02 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:53.556 18:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:54.124 nvme0n1 00:21:54.124 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.124 18:10:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.124 18:10:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.124 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.124 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.124 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.124 18:10:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.124 18:10:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.124 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.124 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.124 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.124 18:10:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:54.125 18:10:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 2 00:21:54.125 18:10:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:54.125 18:10:03 -- host/auth.sh@44 -- # digest=sha256 00:21:54.125 18:10:03 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:54.125 18:10:03 -- host/auth.sh@44 -- # keyid=2 00:21:54.125 18:10:03 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:54.125 18:10:03 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:54.125 18:10:03 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:54.125 18:10:03 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:54.125 18:10:03 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 2 00:21:54.125 18:10:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:54.125 18:10:03 -- host/auth.sh@68 -- # digest=sha256 00:21:54.125 18:10:03 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:54.125 18:10:03 -- host/auth.sh@68 -- # keyid=2 00:21:54.125 18:10:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:54.125 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.125 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.125 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.125 18:10:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:54.125 18:10:03 -- nvmf/common.sh@717 -- # local ip 00:21:54.125 18:10:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:54.125 18:10:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:54.125 18:10:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:54.125 18:10:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:54.125 18:10:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:54.125 18:10:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:54.125 18:10:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:54.125 18:10:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:54.125 18:10:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:54.125 18:10:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:54.125 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.125 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.383 nvme0n1 00:21:54.383 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.383 18:10:03 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.383 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.383 18:10:03 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.383 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.383 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.640 18:10:03 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.640 18:10:03 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.640 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.640 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.640 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.641 18:10:03 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:54.641 18:10:03 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 3 00:21:54.641 18:10:03 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:54.641 18:10:03 -- host/auth.sh@44 -- # digest=sha256 00:21:54.641 18:10:03 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:54.641 18:10:03 -- host/auth.sh@44 -- # keyid=3 00:21:54.641 18:10:03 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:54.641 18:10:03 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:54.641 18:10:03 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:54.641 18:10:03 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:54.641 18:10:03 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 3 00:21:54.641 18:10:03 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:54.641 18:10:03 -- host/auth.sh@68 -- # digest=sha256 00:21:54.641 18:10:03 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:54.641 18:10:03 -- host/auth.sh@68 -- # keyid=3 00:21:54.641 18:10:03 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:54.641 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.641 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.641 18:10:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.641 18:10:03 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:54.641 18:10:03 -- nvmf/common.sh@717 -- # local ip 00:21:54.641 18:10:03 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:54.641 18:10:03 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:54.641 18:10:03 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:54.641 18:10:03 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:54.641 18:10:03 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:54.641 18:10:03 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:54.641 18:10:03 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:54.641 18:10:03 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:54.641 18:10:03 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:54.641 18:10:03 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:54.641 18:10:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.641 18:10:03 -- common/autotest_common.sh@10 -- # set +x 00:21:54.898 nvme0n1 00:21:54.898 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.898 18:10:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:54.898 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.898 18:10:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:54.898 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:54.898 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.898 18:10:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:54.898 18:10:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:54.898 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.898 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:54.898 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:54.898 18:10:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:54.898 18:10:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe6144 4 00:21:54.898 18:10:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:54.898 18:10:04 -- host/auth.sh@44 -- # digest=sha256 00:21:54.898 18:10:04 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:21:54.898 18:10:04 -- host/auth.sh@44 -- # keyid=4 00:21:54.899 18:10:04 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:54.899 18:10:04 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:54.899 18:10:04 -- host/auth.sh@48 -- # echo ffdhe6144 00:21:54.899 18:10:04 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:54.899 18:10:04 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe6144 4 00:21:54.899 18:10:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:54.899 18:10:04 -- host/auth.sh@68 -- # digest=sha256 00:21:54.899 18:10:04 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:21:54.899 18:10:04 -- host/auth.sh@68 -- # keyid=4 00:21:54.899 18:10:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe6144 00:21:54.899 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:54.899 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:54.899 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.156 18:10:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:55.156 18:10:04 -- nvmf/common.sh@717 -- # local ip 00:21:55.156 18:10:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:55.156 18:10:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:55.156 18:10:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:55.156 18:10:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:55.156 18:10:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:55.156 18:10:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:55.156 18:10:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:55.156 18:10:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:55.156 18:10:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:55.156 18:10:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:55.156 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.156 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.415 nvme0n1 00:21:55.415 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.415 18:10:04 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:55.415 18:10:04 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:55.415 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.415 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.415 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.415 18:10:04 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:55.415 18:10:04 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:55.415 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.415 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.415 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.415 18:10:04 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:55.415 18:10:04 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:55.415 18:10:04 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 0 00:21:55.415 18:10:04 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:55.415 18:10:04 -- host/auth.sh@44 -- # digest=sha256 00:21:55.415 18:10:04 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:55.415 18:10:04 -- host/auth.sh@44 -- # keyid=0 00:21:55.415 18:10:04 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:55.415 18:10:04 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:55.415 18:10:04 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:55.415 18:10:04 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:55.415 18:10:04 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 0 00:21:55.415 18:10:04 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:55.415 18:10:04 -- host/auth.sh@68 -- # digest=sha256 00:21:55.415 18:10:04 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:55.415 18:10:04 -- host/auth.sh@68 -- # keyid=0 00:21:55.415 18:10:04 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:55.415 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.415 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.415 18:10:04 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.415 18:10:04 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:55.415 18:10:04 -- nvmf/common.sh@717 -- # local ip 00:21:55.415 18:10:04 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:55.415 18:10:04 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:55.415 18:10:04 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:55.415 18:10:04 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:55.415 18:10:04 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:55.415 18:10:04 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:55.415 18:10:04 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:55.415 18:10:04 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:55.415 18:10:04 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:55.415 18:10:04 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:55.415 18:10:04 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.415 18:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:55.982 nvme0n1 00:21:55.982 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.982 18:10:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:55.982 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.982 18:10:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:55.982 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:55.982 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.982 18:10:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:55.982 18:10:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:55.982 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.982 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:55.982 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:55.982 18:10:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:55.982 18:10:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 1 00:21:55.982 18:10:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:55.982 18:10:05 -- host/auth.sh@44 -- # digest=sha256 00:21:55.982 18:10:05 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:55.982 18:10:05 -- host/auth.sh@44 -- # keyid=1 00:21:55.982 18:10:05 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:55.982 18:10:05 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:55.982 18:10:05 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:55.982 18:10:05 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:55.982 18:10:05 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 1 00:21:55.982 18:10:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:55.982 18:10:05 -- host/auth.sh@68 -- # digest=sha256 00:21:55.982 18:10:05 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:55.982 18:10:05 -- host/auth.sh@68 -- # keyid=1 00:21:55.982 18:10:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:55.982 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:55.982 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:56.240 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:56.240 18:10:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:56.240 18:10:05 -- nvmf/common.sh@717 -- # local ip 00:21:56.240 18:10:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:56.240 18:10:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:56.240 18:10:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:56.240 18:10:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:56.240 18:10:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:56.240 18:10:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:56.240 18:10:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:56.240 18:10:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:56.240 18:10:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:56.240 18:10:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:56.240 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:56.241 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:56.807 nvme0n1 00:21:56.807 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:56.807 18:10:05 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:56.807 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:56.807 18:10:05 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:56.807 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:56.807 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:56.807 18:10:05 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:56.807 18:10:05 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:56.807 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:56.807 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:56.807 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:56.807 18:10:05 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:56.807 18:10:05 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 2 00:21:56.807 18:10:05 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:56.807 18:10:05 -- host/auth.sh@44 -- # digest=sha256 00:21:56.807 18:10:05 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:56.807 18:10:05 -- host/auth.sh@44 -- # keyid=2 00:21:56.807 18:10:05 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:56.807 18:10:05 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:56.807 18:10:05 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:56.807 18:10:05 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:56.807 18:10:05 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 2 00:21:56.808 18:10:05 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:56.808 18:10:05 -- host/auth.sh@68 -- # digest=sha256 00:21:56.808 18:10:05 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:56.808 18:10:05 -- host/auth.sh@68 -- # keyid=2 00:21:56.808 18:10:05 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:56.808 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:56.808 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:56.808 18:10:05 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:56.808 18:10:05 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:56.808 18:10:05 -- nvmf/common.sh@717 -- # local ip 00:21:56.808 18:10:05 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:56.808 18:10:05 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:56.808 18:10:05 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:56.808 18:10:05 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:56.808 18:10:05 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:56.808 18:10:05 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:56.808 18:10:05 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:56.808 18:10:05 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:56.808 18:10:05 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:56.808 18:10:05 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:56.808 18:10:05 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:56.808 18:10:05 -- common/autotest_common.sh@10 -- # set +x 00:21:57.375 nvme0n1 00:21:57.375 18:10:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.375 18:10:06 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:57.375 18:10:06 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:57.375 18:10:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.375 18:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:57.375 18:10:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.375 18:10:06 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:57.375 18:10:06 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:57.375 18:10:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.375 18:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:57.375 18:10:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.375 18:10:06 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:57.375 18:10:06 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 3 00:21:57.375 18:10:06 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:57.375 18:10:06 -- host/auth.sh@44 -- # digest=sha256 00:21:57.375 18:10:06 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:57.375 18:10:06 -- host/auth.sh@44 -- # keyid=3 00:21:57.375 18:10:06 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:57.375 18:10:06 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:57.375 18:10:06 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:57.375 18:10:06 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:57.375 18:10:06 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 3 00:21:57.375 18:10:06 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:57.375 18:10:06 -- host/auth.sh@68 -- # digest=sha256 00:21:57.375 18:10:06 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:57.375 18:10:06 -- host/auth.sh@68 -- # keyid=3 00:21:57.375 18:10:06 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:57.375 18:10:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.375 18:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:57.375 18:10:06 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.375 18:10:06 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:57.375 18:10:06 -- nvmf/common.sh@717 -- # local ip 00:21:57.375 18:10:06 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:57.375 18:10:06 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:57.375 18:10:06 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:57.375 18:10:06 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:57.375 18:10:06 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:57.375 18:10:06 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:57.375 18:10:06 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:57.375 18:10:06 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:57.375 18:10:06 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:57.375 18:10:06 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:57.375 18:10:06 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.375 18:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:57.942 nvme0n1 00:21:57.943 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.943 18:10:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:57.943 18:10:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:57.943 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.943 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:57.943 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.943 18:10:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:57.943 18:10:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:57.943 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.943 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:57.943 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.943 18:10:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:57.943 18:10:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha256 ffdhe8192 4 00:21:57.943 18:10:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:57.943 18:10:07 -- host/auth.sh@44 -- # digest=sha256 00:21:57.943 18:10:07 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:21:57.943 18:10:07 -- host/auth.sh@44 -- # keyid=4 00:21:57.943 18:10:07 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:57.943 18:10:07 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:21:57.943 18:10:07 -- host/auth.sh@48 -- # echo ffdhe8192 00:21:57.943 18:10:07 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:57.943 18:10:07 -- host/auth.sh@111 -- # connect_authenticate sha256 ffdhe8192 4 00:21:57.943 18:10:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:57.943 18:10:07 -- host/auth.sh@68 -- # digest=sha256 00:21:57.943 18:10:07 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:21:57.943 18:10:07 -- host/auth.sh@68 -- # keyid=4 00:21:57.943 18:10:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe8192 00:21:57.943 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.943 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:57.943 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:57.943 18:10:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:57.943 18:10:07 -- nvmf/common.sh@717 -- # local ip 00:21:57.943 18:10:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:57.943 18:10:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:57.943 18:10:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:57.943 18:10:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:57.943 18:10:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:57.943 18:10:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:57.943 18:10:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:57.943 18:10:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:57.943 18:10:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:57.943 18:10:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:57.943 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:57.943 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.510 nvme0n1 00:21:58.510 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:58.510 18:10:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:58.510 18:10:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:58.510 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:58.510 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.510 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:58.769 18:10:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:58.769 18:10:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:58.769 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:58.769 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.769 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:58.769 18:10:07 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:21:58.769 18:10:07 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:21:58.769 18:10:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:58.769 18:10:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 0 00:21:58.769 18:10:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:58.769 18:10:07 -- host/auth.sh@44 -- # digest=sha384 00:21:58.769 18:10:07 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:58.769 18:10:07 -- host/auth.sh@44 -- # keyid=0 00:21:58.769 18:10:07 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:58.769 18:10:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:58.769 18:10:07 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:58.769 18:10:07 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:21:58.769 18:10:07 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 0 00:21:58.769 18:10:07 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:58.769 18:10:07 -- host/auth.sh@68 -- # digest=sha384 00:21:58.769 18:10:07 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:58.769 18:10:07 -- host/auth.sh@68 -- # keyid=0 00:21:58.769 18:10:07 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:58.769 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:58.769 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.769 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:58.769 18:10:07 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:58.769 18:10:07 -- nvmf/common.sh@717 -- # local ip 00:21:58.769 18:10:07 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:58.769 18:10:07 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:58.769 18:10:07 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:58.769 18:10:07 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:58.769 18:10:07 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:58.769 18:10:07 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:58.769 18:10:07 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:58.769 18:10:07 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:58.769 18:10:07 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:58.769 18:10:07 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:21:58.769 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:58.769 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.769 nvme0n1 00:21:58.769 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:58.769 18:10:07 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:58.769 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:58.769 18:10:07 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:58.769 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:58.769 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.028 18:10:07 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.028 18:10:07 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.028 18:10:07 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.028 18:10:07 -- common/autotest_common.sh@10 -- # set +x 00:21:59.028 18:10:07 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.028 18:10:07 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.028 18:10:07 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 1 00:21:59.028 18:10:07 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.028 18:10:07 -- host/auth.sh@44 -- # digest=sha384 00:21:59.028 18:10:07 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.028 18:10:07 -- host/auth.sh@44 -- # keyid=1 00:21:59.028 18:10:07 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:59.028 18:10:07 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:59.028 18:10:07 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.028 18:10:07 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:21:59.028 18:10:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 1 00:21:59.028 18:10:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.028 18:10:08 -- host/auth.sh@68 -- # digest=sha384 00:21:59.028 18:10:08 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.028 18:10:08 -- host/auth.sh@68 -- # keyid=1 00:21:59.028 18:10:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:59.028 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.028 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.028 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.028 18:10:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.028 18:10:08 -- nvmf/common.sh@717 -- # local ip 00:21:59.028 18:10:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.028 18:10:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.028 18:10:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.028 18:10:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.028 18:10:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.028 18:10:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.028 18:10:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.028 18:10:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.028 18:10:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.028 18:10:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:21:59.028 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.028 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.028 nvme0n1 00:21:59.028 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.028 18:10:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.028 18:10:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.028 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.028 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.028 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.286 18:10:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.287 18:10:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.287 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.287 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.287 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.287 18:10:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.287 18:10:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 2 00:21:59.287 18:10:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.287 18:10:08 -- host/auth.sh@44 -- # digest=sha384 00:21:59.287 18:10:08 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.287 18:10:08 -- host/auth.sh@44 -- # keyid=2 00:21:59.287 18:10:08 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:59.287 18:10:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:59.287 18:10:08 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.287 18:10:08 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:21:59.287 18:10:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 2 00:21:59.287 18:10:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.287 18:10:08 -- host/auth.sh@68 -- # digest=sha384 00:21:59.287 18:10:08 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.287 18:10:08 -- host/auth.sh@68 -- # keyid=2 00:21:59.287 18:10:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:59.287 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.287 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.287 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.287 18:10:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.287 18:10:08 -- nvmf/common.sh@717 -- # local ip 00:21:59.287 18:10:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.287 18:10:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.287 18:10:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.287 18:10:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.287 18:10:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.287 18:10:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.287 18:10:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.287 18:10:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.287 18:10:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.287 18:10:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:21:59.287 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.287 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.287 nvme0n1 00:21:59.287 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.287 18:10:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.287 18:10:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.287 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.287 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.287 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.544 18:10:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.544 18:10:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.544 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.545 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.545 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.545 18:10:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.545 18:10:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 3 00:21:59.545 18:10:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.545 18:10:08 -- host/auth.sh@44 -- # digest=sha384 00:21:59.545 18:10:08 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.545 18:10:08 -- host/auth.sh@44 -- # keyid=3 00:21:59.545 18:10:08 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:59.545 18:10:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:59.545 18:10:08 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.545 18:10:08 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:21:59.545 18:10:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 3 00:21:59.545 18:10:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.545 18:10:08 -- host/auth.sh@68 -- # digest=sha384 00:21:59.545 18:10:08 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.545 18:10:08 -- host/auth.sh@68 -- # keyid=3 00:21:59.545 18:10:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:59.545 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.545 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.545 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.545 18:10:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.545 18:10:08 -- nvmf/common.sh@717 -- # local ip 00:21:59.545 18:10:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.545 18:10:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.545 18:10:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.545 18:10:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.545 18:10:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.545 18:10:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.545 18:10:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.545 18:10:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.545 18:10:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.545 18:10:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:21:59.545 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.545 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.545 nvme0n1 00:21:59.545 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.545 18:10:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.545 18:10:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.545 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.545 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.802 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.802 18:10:08 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:21:59.802 18:10:08 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:21:59.802 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.802 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.802 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.802 18:10:08 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:21:59.802 18:10:08 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe2048 4 00:21:59.802 18:10:08 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:21:59.802 18:10:08 -- host/auth.sh@44 -- # digest=sha384 00:21:59.802 18:10:08 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:21:59.802 18:10:08 -- host/auth.sh@44 -- # keyid=4 00:21:59.802 18:10:08 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:59.802 18:10:08 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:21:59.802 18:10:08 -- host/auth.sh@48 -- # echo ffdhe2048 00:21:59.802 18:10:08 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:21:59.802 18:10:08 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe2048 4 00:21:59.802 18:10:08 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:21:59.802 18:10:08 -- host/auth.sh@68 -- # digest=sha384 00:21:59.802 18:10:08 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:21:59.802 18:10:08 -- host/auth.sh@68 -- # keyid=4 00:21:59.802 18:10:08 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe2048 00:21:59.803 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.803 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.803 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.803 18:10:08 -- host/auth.sh@70 -- # get_main_ns_ip 00:21:59.803 18:10:08 -- nvmf/common.sh@717 -- # local ip 00:21:59.803 18:10:08 -- nvmf/common.sh@718 -- # ip_candidates=() 00:21:59.803 18:10:08 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:21:59.803 18:10:08 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:21:59.803 18:10:08 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:21:59.803 18:10:08 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:21:59.803 18:10:08 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:21:59.803 18:10:08 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:21:59.803 18:10:08 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:21:59.803 18:10:08 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:21:59.803 18:10:08 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:21:59.803 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.803 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:21:59.803 nvme0n1 00:21:59.803 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:21:59.803 18:10:08 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:21:59.803 18:10:08 -- host/auth.sh@73 -- # jq -r '.[].name' 00:21:59.803 18:10:08 -- common/autotest_common.sh@559 -- # xtrace_disable 00:21:59.803 18:10:08 -- common/autotest_common.sh@10 -- # set +x 00:22:00.062 18:10:08 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.062 18:10:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.062 18:10:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.062 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.062 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.062 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.062 18:10:09 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:00.062 18:10:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.062 18:10:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 0 00:22:00.062 18:10:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.062 18:10:09 -- host/auth.sh@44 -- # digest=sha384 00:22:00.062 18:10:09 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:00.062 18:10:09 -- host/auth.sh@44 -- # keyid=0 00:22:00.062 18:10:09 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:00.062 18:10:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:00.062 18:10:09 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:00.062 18:10:09 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:00.062 18:10:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 0 00:22:00.062 18:10:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.062 18:10:09 -- host/auth.sh@68 -- # digest=sha384 00:22:00.062 18:10:09 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:00.062 18:10:09 -- host/auth.sh@68 -- # keyid=0 00:22:00.062 18:10:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:22:00.062 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.062 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.062 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.062 18:10:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.062 18:10:09 -- nvmf/common.sh@717 -- # local ip 00:22:00.062 18:10:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.062 18:10:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.062 18:10:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.062 18:10:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.062 18:10:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.062 18:10:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.062 18:10:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.062 18:10:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.062 18:10:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.062 18:10:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:00.062 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.062 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.321 nvme0n1 00:22:00.321 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.321 18:10:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.321 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.321 18:10:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.321 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.321 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.321 18:10:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.321 18:10:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.321 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.321 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.321 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.321 18:10:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.321 18:10:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 1 00:22:00.321 18:10:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.321 18:10:09 -- host/auth.sh@44 -- # digest=sha384 00:22:00.321 18:10:09 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:00.321 18:10:09 -- host/auth.sh@44 -- # keyid=1 00:22:00.321 18:10:09 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:00.321 18:10:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:00.321 18:10:09 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:00.321 18:10:09 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:00.321 18:10:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 1 00:22:00.321 18:10:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.321 18:10:09 -- host/auth.sh@68 -- # digest=sha384 00:22:00.321 18:10:09 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:00.321 18:10:09 -- host/auth.sh@68 -- # keyid=1 00:22:00.321 18:10:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:22:00.321 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.321 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.321 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.321 18:10:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.321 18:10:09 -- nvmf/common.sh@717 -- # local ip 00:22:00.321 18:10:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.321 18:10:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.321 18:10:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.321 18:10:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.321 18:10:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.321 18:10:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.321 18:10:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.321 18:10:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.321 18:10:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.321 18:10:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:00.321 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.321 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.580 nvme0n1 00:22:00.580 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.580 18:10:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.580 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.580 18:10:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.580 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.580 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.580 18:10:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.580 18:10:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.580 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.580 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.580 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.580 18:10:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.580 18:10:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 2 00:22:00.580 18:10:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.580 18:10:09 -- host/auth.sh@44 -- # digest=sha384 00:22:00.580 18:10:09 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:00.580 18:10:09 -- host/auth.sh@44 -- # keyid=2 00:22:00.580 18:10:09 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:00.580 18:10:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:00.580 18:10:09 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:00.580 18:10:09 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:00.580 18:10:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 2 00:22:00.580 18:10:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.580 18:10:09 -- host/auth.sh@68 -- # digest=sha384 00:22:00.580 18:10:09 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:00.580 18:10:09 -- host/auth.sh@68 -- # keyid=2 00:22:00.580 18:10:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:22:00.580 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.580 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.580 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.580 18:10:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.580 18:10:09 -- nvmf/common.sh@717 -- # local ip 00:22:00.580 18:10:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.580 18:10:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.580 18:10:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.580 18:10:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.580 18:10:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.580 18:10:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.580 18:10:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.580 18:10:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.580 18:10:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.580 18:10:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:00.580 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.580 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.839 nvme0n1 00:22:00.839 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.839 18:10:09 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:00.839 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.839 18:10:09 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:00.839 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.839 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.839 18:10:09 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:00.839 18:10:09 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:00.839 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.839 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.839 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.839 18:10:09 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:00.839 18:10:09 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 3 00:22:00.839 18:10:09 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:00.839 18:10:09 -- host/auth.sh@44 -- # digest=sha384 00:22:00.839 18:10:09 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:00.839 18:10:09 -- host/auth.sh@44 -- # keyid=3 00:22:00.839 18:10:09 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:00.839 18:10:09 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:00.839 18:10:09 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:00.839 18:10:09 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:00.839 18:10:09 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 3 00:22:00.839 18:10:09 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:00.839 18:10:09 -- host/auth.sh@68 -- # digest=sha384 00:22:00.839 18:10:09 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:00.839 18:10:09 -- host/auth.sh@68 -- # keyid=3 00:22:00.839 18:10:09 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:22:00.839 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.839 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:00.839 18:10:09 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:00.839 18:10:09 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:00.839 18:10:09 -- nvmf/common.sh@717 -- # local ip 00:22:00.839 18:10:09 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:00.839 18:10:09 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:00.839 18:10:09 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:00.839 18:10:09 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:00.840 18:10:09 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:00.840 18:10:09 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:00.840 18:10:09 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:00.840 18:10:09 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:00.840 18:10:09 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:00.840 18:10:09 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:00.840 18:10:09 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:00.840 18:10:09 -- common/autotest_common.sh@10 -- # set +x 00:22:01.103 nvme0n1 00:22:01.103 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.103 18:10:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.103 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.103 18:10:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.103 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.103 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.103 18:10:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.103 18:10:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.103 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.103 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.103 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.103 18:10:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.103 18:10:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe3072 4 00:22:01.103 18:10:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.103 18:10:10 -- host/auth.sh@44 -- # digest=sha384 00:22:01.103 18:10:10 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:01.103 18:10:10 -- host/auth.sh@44 -- # keyid=4 00:22:01.103 18:10:10 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:01.103 18:10:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:01.103 18:10:10 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:01.103 18:10:10 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:01.103 18:10:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe3072 4 00:22:01.103 18:10:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.103 18:10:10 -- host/auth.sh@68 -- # digest=sha384 00:22:01.103 18:10:10 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:01.103 18:10:10 -- host/auth.sh@68 -- # keyid=4 00:22:01.103 18:10:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe3072 00:22:01.103 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.103 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.103 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.103 18:10:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.103 18:10:10 -- nvmf/common.sh@717 -- # local ip 00:22:01.103 18:10:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.103 18:10:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.103 18:10:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.103 18:10:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.103 18:10:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.103 18:10:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.103 18:10:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.103 18:10:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.103 18:10:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.103 18:10:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:01.103 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.103 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.360 nvme0n1 00:22:01.360 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.360 18:10:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.360 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.361 18:10:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.361 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.361 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.361 18:10:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.361 18:10:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.361 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.361 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.361 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.361 18:10:10 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:01.361 18:10:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.361 18:10:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 0 00:22:01.361 18:10:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.361 18:10:10 -- host/auth.sh@44 -- # digest=sha384 00:22:01.361 18:10:10 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:01.361 18:10:10 -- host/auth.sh@44 -- # keyid=0 00:22:01.361 18:10:10 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:01.361 18:10:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:01.361 18:10:10 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:01.361 18:10:10 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:01.361 18:10:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 0 00:22:01.361 18:10:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.361 18:10:10 -- host/auth.sh@68 -- # digest=sha384 00:22:01.361 18:10:10 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:01.361 18:10:10 -- host/auth.sh@68 -- # keyid=0 00:22:01.361 18:10:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:22:01.361 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.361 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.361 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.361 18:10:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.361 18:10:10 -- nvmf/common.sh@717 -- # local ip 00:22:01.361 18:10:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.361 18:10:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.361 18:10:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.361 18:10:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.361 18:10:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.361 18:10:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.361 18:10:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.361 18:10:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.361 18:10:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.361 18:10:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:01.361 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.361 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.619 nvme0n1 00:22:01.619 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.619 18:10:10 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:01.619 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.619 18:10:10 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:01.619 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.619 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.619 18:10:10 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:01.619 18:10:10 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:01.619 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.619 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.619 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.619 18:10:10 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:01.619 18:10:10 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 1 00:22:01.619 18:10:10 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:01.877 18:10:10 -- host/auth.sh@44 -- # digest=sha384 00:22:01.877 18:10:10 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:01.877 18:10:10 -- host/auth.sh@44 -- # keyid=1 00:22:01.877 18:10:10 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:01.877 18:10:10 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:01.877 18:10:10 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:01.877 18:10:10 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:01.877 18:10:10 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 1 00:22:01.877 18:10:10 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:01.877 18:10:10 -- host/auth.sh@68 -- # digest=sha384 00:22:01.877 18:10:10 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:01.877 18:10:10 -- host/auth.sh@68 -- # keyid=1 00:22:01.877 18:10:10 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:22:01.877 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.877 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:01.877 18:10:10 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:01.877 18:10:10 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:01.877 18:10:10 -- nvmf/common.sh@717 -- # local ip 00:22:01.877 18:10:10 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:01.877 18:10:10 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:01.877 18:10:10 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:01.877 18:10:10 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:01.877 18:10:10 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:01.877 18:10:10 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:01.877 18:10:10 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:01.877 18:10:10 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:01.877 18:10:10 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:01.877 18:10:10 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:01.877 18:10:10 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:01.877 18:10:10 -- common/autotest_common.sh@10 -- # set +x 00:22:02.136 nvme0n1 00:22:02.136 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.136 18:10:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.136 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.136 18:10:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.136 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.136 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.136 18:10:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.136 18:10:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.136 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.136 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.136 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.136 18:10:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.136 18:10:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 2 00:22:02.136 18:10:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.136 18:10:11 -- host/auth.sh@44 -- # digest=sha384 00:22:02.136 18:10:11 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.136 18:10:11 -- host/auth.sh@44 -- # keyid=2 00:22:02.136 18:10:11 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:02.136 18:10:11 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:02.136 18:10:11 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.136 18:10:11 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:02.136 18:10:11 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 2 00:22:02.136 18:10:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.136 18:10:11 -- host/auth.sh@68 -- # digest=sha384 00:22:02.136 18:10:11 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.136 18:10:11 -- host/auth.sh@68 -- # keyid=2 00:22:02.136 18:10:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:22:02.136 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.136 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.136 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.136 18:10:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.136 18:10:11 -- nvmf/common.sh@717 -- # local ip 00:22:02.136 18:10:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.136 18:10:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.136 18:10:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.136 18:10:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.136 18:10:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.136 18:10:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.136 18:10:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.136 18:10:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.136 18:10:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.136 18:10:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:02.136 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.136 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.395 nvme0n1 00:22:02.395 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.395 18:10:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.395 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.395 18:10:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.395 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.395 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.395 18:10:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.395 18:10:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.395 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.395 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.395 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.395 18:10:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.395 18:10:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 3 00:22:02.395 18:10:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.395 18:10:11 -- host/auth.sh@44 -- # digest=sha384 00:22:02.395 18:10:11 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.395 18:10:11 -- host/auth.sh@44 -- # keyid=3 00:22:02.395 18:10:11 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:02.395 18:10:11 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:02.395 18:10:11 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.395 18:10:11 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:02.395 18:10:11 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 3 00:22:02.395 18:10:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.395 18:10:11 -- host/auth.sh@68 -- # digest=sha384 00:22:02.395 18:10:11 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.395 18:10:11 -- host/auth.sh@68 -- # keyid=3 00:22:02.395 18:10:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:22:02.395 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.395 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.395 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.395 18:10:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.395 18:10:11 -- nvmf/common.sh@717 -- # local ip 00:22:02.395 18:10:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.395 18:10:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.395 18:10:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.395 18:10:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.395 18:10:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.395 18:10:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.395 18:10:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.395 18:10:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.395 18:10:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.395 18:10:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:02.395 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.395 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.654 nvme0n1 00:22:02.654 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.654 18:10:11 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.654 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.654 18:10:11 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.654 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.654 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.654 18:10:11 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:02.654 18:10:11 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:02.654 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.654 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.654 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.654 18:10:11 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:02.654 18:10:11 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe4096 4 00:22:02.654 18:10:11 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:02.654 18:10:11 -- host/auth.sh@44 -- # digest=sha384 00:22:02.654 18:10:11 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:02.654 18:10:11 -- host/auth.sh@44 -- # keyid=4 00:22:02.654 18:10:11 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:02.654 18:10:11 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:02.654 18:10:11 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:02.654 18:10:11 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:02.654 18:10:11 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe4096 4 00:22:02.654 18:10:11 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:02.654 18:10:11 -- host/auth.sh@68 -- # digest=sha384 00:22:02.654 18:10:11 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:02.654 18:10:11 -- host/auth.sh@68 -- # keyid=4 00:22:02.654 18:10:11 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe4096 00:22:02.654 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.654 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.654 18:10:11 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.654 18:10:11 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:02.654 18:10:11 -- nvmf/common.sh@717 -- # local ip 00:22:02.654 18:10:11 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:02.654 18:10:11 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:02.654 18:10:11 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:02.654 18:10:11 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:02.654 18:10:11 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:02.654 18:10:11 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:02.654 18:10:11 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:02.654 18:10:11 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:02.654 18:10:11 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:02.654 18:10:11 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:02.654 18:10:11 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.654 18:10:11 -- common/autotest_common.sh@10 -- # set +x 00:22:02.912 nvme0n1 00:22:02.912 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:02.912 18:10:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:02.912 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:02.913 18:10:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:02.913 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.171 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.171 18:10:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.171 18:10:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.171 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.171 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.171 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.171 18:10:12 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:03.171 18:10:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.171 18:10:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 0 00:22:03.171 18:10:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.171 18:10:12 -- host/auth.sh@44 -- # digest=sha384 00:22:03.171 18:10:12 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:03.171 18:10:12 -- host/auth.sh@44 -- # keyid=0 00:22:03.171 18:10:12 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:03.171 18:10:12 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:03.171 18:10:12 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:03.171 18:10:12 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:03.171 18:10:12 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 0 00:22:03.171 18:10:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.171 18:10:12 -- host/auth.sh@68 -- # digest=sha384 00:22:03.171 18:10:12 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:03.171 18:10:12 -- host/auth.sh@68 -- # keyid=0 00:22:03.171 18:10:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:22:03.171 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.171 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.171 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.171 18:10:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:03.171 18:10:12 -- nvmf/common.sh@717 -- # local ip 00:22:03.171 18:10:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:03.171 18:10:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:03.171 18:10:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:03.171 18:10:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:03.172 18:10:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:03.172 18:10:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:03.172 18:10:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:03.172 18:10:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:03.172 18:10:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:03.172 18:10:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:03.172 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.172 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.430 nvme0n1 00:22:03.430 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.430 18:10:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:03.430 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.430 18:10:12 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:03.430 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.430 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.430 18:10:12 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.430 18:10:12 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.430 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.430 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.430 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.430 18:10:12 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.430 18:10:12 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 1 00:22:03.430 18:10:12 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.430 18:10:12 -- host/auth.sh@44 -- # digest=sha384 00:22:03.430 18:10:12 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:03.430 18:10:12 -- host/auth.sh@44 -- # keyid=1 00:22:03.430 18:10:12 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:03.430 18:10:12 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:03.430 18:10:12 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:03.430 18:10:12 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:03.430 18:10:12 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 1 00:22:03.430 18:10:12 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.430 18:10:12 -- host/auth.sh@68 -- # digest=sha384 00:22:03.430 18:10:12 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:03.430 18:10:12 -- host/auth.sh@68 -- # keyid=1 00:22:03.430 18:10:12 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:22:03.430 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.430 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.688 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.688 18:10:12 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:03.688 18:10:12 -- nvmf/common.sh@717 -- # local ip 00:22:03.688 18:10:12 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:03.688 18:10:12 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:03.688 18:10:12 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:03.688 18:10:12 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:03.688 18:10:12 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:03.688 18:10:12 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:03.688 18:10:12 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:03.688 18:10:12 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:03.688 18:10:12 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:03.688 18:10:12 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:03.689 18:10:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.689 18:10:12 -- common/autotest_common.sh@10 -- # set +x 00:22:03.947 nvme0n1 00:22:03.947 18:10:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.947 18:10:12 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:03.947 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.947 18:10:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:03.947 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:03.947 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.947 18:10:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:03.947 18:10:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:03.947 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.947 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:03.947 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.947 18:10:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:03.947 18:10:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 2 00:22:03.947 18:10:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:03.947 18:10:13 -- host/auth.sh@44 -- # digest=sha384 00:22:03.947 18:10:13 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:03.947 18:10:13 -- host/auth.sh@44 -- # keyid=2 00:22:03.947 18:10:13 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:03.947 18:10:13 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:03.947 18:10:13 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:03.947 18:10:13 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:03.947 18:10:13 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 2 00:22:03.947 18:10:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:03.947 18:10:13 -- host/auth.sh@68 -- # digest=sha384 00:22:03.947 18:10:13 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:03.947 18:10:13 -- host/auth.sh@68 -- # keyid=2 00:22:03.947 18:10:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:22:03.947 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.947 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:03.947 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:03.947 18:10:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:03.947 18:10:13 -- nvmf/common.sh@717 -- # local ip 00:22:03.947 18:10:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:03.947 18:10:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:03.947 18:10:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:03.947 18:10:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:03.947 18:10:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:03.947 18:10:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:03.947 18:10:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:03.947 18:10:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:03.947 18:10:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:03.947 18:10:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:03.947 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:03.947 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.529 nvme0n1 00:22:04.529 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.529 18:10:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:04.529 18:10:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:04.529 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.529 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.529 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.529 18:10:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:04.529 18:10:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:04.529 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.529 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.529 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.529 18:10:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:04.529 18:10:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 3 00:22:04.529 18:10:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:04.529 18:10:13 -- host/auth.sh@44 -- # digest=sha384 00:22:04.529 18:10:13 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:04.529 18:10:13 -- host/auth.sh@44 -- # keyid=3 00:22:04.529 18:10:13 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:04.529 18:10:13 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:04.529 18:10:13 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:04.529 18:10:13 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:04.529 18:10:13 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 3 00:22:04.529 18:10:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:04.529 18:10:13 -- host/auth.sh@68 -- # digest=sha384 00:22:04.529 18:10:13 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:04.529 18:10:13 -- host/auth.sh@68 -- # keyid=3 00:22:04.529 18:10:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:22:04.529 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.529 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.529 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.529 18:10:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:04.529 18:10:13 -- nvmf/common.sh@717 -- # local ip 00:22:04.529 18:10:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:04.529 18:10:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:04.529 18:10:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:04.529 18:10:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:04.529 18:10:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:04.529 18:10:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:04.529 18:10:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:04.529 18:10:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:04.529 18:10:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:04.529 18:10:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:04.529 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.529 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.787 nvme0n1 00:22:04.787 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.787 18:10:13 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:04.787 18:10:13 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:04.787 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.787 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.787 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.787 18:10:13 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:04.787 18:10:13 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:04.787 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.787 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:04.787 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:04.787 18:10:13 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:04.787 18:10:13 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe6144 4 00:22:04.787 18:10:13 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:04.787 18:10:13 -- host/auth.sh@44 -- # digest=sha384 00:22:04.787 18:10:13 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:04.787 18:10:13 -- host/auth.sh@44 -- # keyid=4 00:22:04.787 18:10:13 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:04.787 18:10:13 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:04.787 18:10:13 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:04.787 18:10:13 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:04.787 18:10:13 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe6144 4 00:22:04.787 18:10:13 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:04.787 18:10:13 -- host/auth.sh@68 -- # digest=sha384 00:22:04.787 18:10:13 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:04.787 18:10:13 -- host/auth.sh@68 -- # keyid=4 00:22:04.787 18:10:13 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe6144 00:22:04.787 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:04.787 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:05.045 18:10:13 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.045 18:10:13 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:05.045 18:10:13 -- nvmf/common.sh@717 -- # local ip 00:22:05.045 18:10:13 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:05.045 18:10:13 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:05.045 18:10:13 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:05.045 18:10:13 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:05.045 18:10:13 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:05.045 18:10:13 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:05.045 18:10:13 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:05.045 18:10:13 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:05.045 18:10:13 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:05.045 18:10:13 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:05.045 18:10:13 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.045 18:10:13 -- common/autotest_common.sh@10 -- # set +x 00:22:05.303 nvme0n1 00:22:05.303 18:10:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.303 18:10:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:05.303 18:10:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.303 18:10:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:05.303 18:10:14 -- common/autotest_common.sh@10 -- # set +x 00:22:05.303 18:10:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.303 18:10:14 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:05.303 18:10:14 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:05.303 18:10:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.303 18:10:14 -- common/autotest_common.sh@10 -- # set +x 00:22:05.303 18:10:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.303 18:10:14 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:05.303 18:10:14 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:05.303 18:10:14 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 0 00:22:05.303 18:10:14 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:05.303 18:10:14 -- host/auth.sh@44 -- # digest=sha384 00:22:05.303 18:10:14 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:05.303 18:10:14 -- host/auth.sh@44 -- # keyid=0 00:22:05.303 18:10:14 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:05.303 18:10:14 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:05.304 18:10:14 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:05.304 18:10:14 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:05.304 18:10:14 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 0 00:22:05.304 18:10:14 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:05.304 18:10:14 -- host/auth.sh@68 -- # digest=sha384 00:22:05.304 18:10:14 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:05.304 18:10:14 -- host/auth.sh@68 -- # keyid=0 00:22:05.304 18:10:14 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:22:05.304 18:10:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.304 18:10:14 -- common/autotest_common.sh@10 -- # set +x 00:22:05.304 18:10:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.304 18:10:14 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:05.304 18:10:14 -- nvmf/common.sh@717 -- # local ip 00:22:05.304 18:10:14 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:05.304 18:10:14 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:05.304 18:10:14 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:05.304 18:10:14 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:05.304 18:10:14 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:05.304 18:10:14 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:05.304 18:10:14 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:05.304 18:10:14 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:05.304 18:10:14 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:05.304 18:10:14 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:05.304 18:10:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.304 18:10:14 -- common/autotest_common.sh@10 -- # set +x 00:22:05.871 nvme0n1 00:22:05.871 18:10:14 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.871 18:10:14 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:05.871 18:10:14 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.871 18:10:14 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:05.871 18:10:14 -- common/autotest_common.sh@10 -- # set +x 00:22:05.871 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.871 18:10:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:05.871 18:10:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:05.871 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:05.871 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:05.871 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:05.871 18:10:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:05.871 18:10:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 1 00:22:05.871 18:10:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:05.871 18:10:15 -- host/auth.sh@44 -- # digest=sha384 00:22:05.871 18:10:15 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:05.871 18:10:15 -- host/auth.sh@44 -- # keyid=1 00:22:05.871 18:10:15 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:05.871 18:10:15 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:05.871 18:10:15 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:05.871 18:10:15 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:06.129 18:10:15 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 1 00:22:06.129 18:10:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:06.129 18:10:15 -- host/auth.sh@68 -- # digest=sha384 00:22:06.129 18:10:15 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:06.129 18:10:15 -- host/auth.sh@68 -- # keyid=1 00:22:06.129 18:10:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:22:06.129 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.129 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:06.129 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:06.129 18:10:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:06.129 18:10:15 -- nvmf/common.sh@717 -- # local ip 00:22:06.129 18:10:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:06.129 18:10:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:06.129 18:10:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:06.129 18:10:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:06.129 18:10:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:06.129 18:10:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:06.129 18:10:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:06.129 18:10:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:06.129 18:10:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:06.129 18:10:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:06.129 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.129 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:06.739 nvme0n1 00:22:06.739 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:06.739 18:10:15 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:06.739 18:10:15 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:06.739 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.739 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:06.739 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:06.739 18:10:15 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:06.739 18:10:15 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:06.739 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.739 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:06.739 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:06.739 18:10:15 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:06.739 18:10:15 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 2 00:22:06.739 18:10:15 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:06.739 18:10:15 -- host/auth.sh@44 -- # digest=sha384 00:22:06.739 18:10:15 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:06.739 18:10:15 -- host/auth.sh@44 -- # keyid=2 00:22:06.739 18:10:15 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:06.739 18:10:15 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:06.739 18:10:15 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:06.739 18:10:15 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:06.739 18:10:15 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 2 00:22:06.739 18:10:15 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:06.739 18:10:15 -- host/auth.sh@68 -- # digest=sha384 00:22:06.739 18:10:15 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:06.739 18:10:15 -- host/auth.sh@68 -- # keyid=2 00:22:06.739 18:10:15 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:22:06.739 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.739 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:06.739 18:10:15 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:06.739 18:10:15 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:06.739 18:10:15 -- nvmf/common.sh@717 -- # local ip 00:22:06.739 18:10:15 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:06.739 18:10:15 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:06.739 18:10:15 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:06.739 18:10:15 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:06.739 18:10:15 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:06.739 18:10:15 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:06.739 18:10:15 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:06.739 18:10:15 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:06.739 18:10:15 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:06.739 18:10:15 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:06.739 18:10:15 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:06.739 18:10:15 -- common/autotest_common.sh@10 -- # set +x 00:22:07.306 nvme0n1 00:22:07.306 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.306 18:10:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:07.306 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.307 18:10:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:07.307 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.307 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.307 18:10:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:07.307 18:10:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:07.307 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.307 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.307 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.307 18:10:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:07.307 18:10:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 3 00:22:07.307 18:10:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:07.307 18:10:16 -- host/auth.sh@44 -- # digest=sha384 00:22:07.307 18:10:16 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:07.307 18:10:16 -- host/auth.sh@44 -- # keyid=3 00:22:07.307 18:10:16 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:07.307 18:10:16 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:07.307 18:10:16 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:07.307 18:10:16 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:07.307 18:10:16 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 3 00:22:07.307 18:10:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:07.307 18:10:16 -- host/auth.sh@68 -- # digest=sha384 00:22:07.307 18:10:16 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:07.307 18:10:16 -- host/auth.sh@68 -- # keyid=3 00:22:07.307 18:10:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:22:07.307 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.307 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.307 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.307 18:10:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:07.307 18:10:16 -- nvmf/common.sh@717 -- # local ip 00:22:07.307 18:10:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:07.307 18:10:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:07.307 18:10:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:07.307 18:10:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:07.307 18:10:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:07.307 18:10:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:07.307 18:10:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:07.307 18:10:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:07.307 18:10:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:07.307 18:10:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:07.307 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.307 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.888 nvme0n1 00:22:07.889 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.889 18:10:16 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:07.889 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.889 18:10:16 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:07.889 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.889 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.889 18:10:16 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:07.889 18:10:16 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:07.889 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.889 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.889 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.889 18:10:16 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:07.889 18:10:16 -- host/auth.sh@110 -- # nvmet_auth_set_key sha384 ffdhe8192 4 00:22:07.889 18:10:16 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:07.889 18:10:16 -- host/auth.sh@44 -- # digest=sha384 00:22:07.889 18:10:16 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:07.889 18:10:16 -- host/auth.sh@44 -- # keyid=4 00:22:07.889 18:10:16 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:07.889 18:10:16 -- host/auth.sh@47 -- # echo 'hmac(sha384)' 00:22:07.889 18:10:16 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:07.889 18:10:16 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:07.889 18:10:16 -- host/auth.sh@111 -- # connect_authenticate sha384 ffdhe8192 4 00:22:07.889 18:10:16 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:07.889 18:10:16 -- host/auth.sh@68 -- # digest=sha384 00:22:07.889 18:10:16 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:07.889 18:10:16 -- host/auth.sh@68 -- # keyid=4 00:22:07.889 18:10:16 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha384 --dhchap-dhgroups ffdhe8192 00:22:07.889 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.889 18:10:16 -- common/autotest_common.sh@10 -- # set +x 00:22:07.889 18:10:16 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:07.889 18:10:16 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:07.889 18:10:16 -- nvmf/common.sh@717 -- # local ip 00:22:07.889 18:10:16 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:07.889 18:10:16 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:07.889 18:10:16 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:07.889 18:10:16 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:07.889 18:10:16 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:07.889 18:10:16 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:07.889 18:10:16 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:07.889 18:10:16 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:07.889 18:10:16 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:07.889 18:10:16 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:07.889 18:10:16 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:07.889 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.455 nvme0n1 00:22:08.455 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.455 18:10:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:08.455 18:10:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:08.455 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.455 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.455 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.455 18:10:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:08.455 18:10:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:08.455 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.455 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.455 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.455 18:10:17 -- host/auth.sh@107 -- # for digest in "${digests[@]}" 00:22:08.455 18:10:17 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:08.455 18:10:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:08.455 18:10:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 0 00:22:08.455 18:10:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:08.455 18:10:17 -- host/auth.sh@44 -- # digest=sha512 00:22:08.455 18:10:17 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:08.455 18:10:17 -- host/auth.sh@44 -- # keyid=0 00:22:08.455 18:10:17 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:08.455 18:10:17 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:08.455 18:10:17 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:08.455 18:10:17 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:08.455 18:10:17 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 0 00:22:08.455 18:10:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:08.455 18:10:17 -- host/auth.sh@68 -- # digest=sha512 00:22:08.455 18:10:17 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:08.455 18:10:17 -- host/auth.sh@68 -- # keyid=0 00:22:08.455 18:10:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:08.455 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.455 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.455 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.455 18:10:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:08.455 18:10:17 -- nvmf/common.sh@717 -- # local ip 00:22:08.455 18:10:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:08.455 18:10:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:08.455 18:10:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:08.455 18:10:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:08.455 18:10:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:08.455 18:10:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:08.455 18:10:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:08.455 18:10:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:08.455 18:10:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:08.455 18:10:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:08.455 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.455 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.714 nvme0n1 00:22:08.714 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.714 18:10:17 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:08.714 18:10:17 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:08.714 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.714 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.714 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.714 18:10:17 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:08.714 18:10:17 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:08.714 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.714 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.714 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.714 18:10:17 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:08.714 18:10:17 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 1 00:22:08.714 18:10:17 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:08.714 18:10:17 -- host/auth.sh@44 -- # digest=sha512 00:22:08.714 18:10:17 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:08.714 18:10:17 -- host/auth.sh@44 -- # keyid=1 00:22:08.714 18:10:17 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:08.714 18:10:17 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:08.714 18:10:17 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:08.714 18:10:17 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:08.714 18:10:17 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 1 00:22:08.714 18:10:17 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:08.714 18:10:17 -- host/auth.sh@68 -- # digest=sha512 00:22:08.714 18:10:17 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:08.714 18:10:17 -- host/auth.sh@68 -- # keyid=1 00:22:08.714 18:10:17 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:08.714 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.714 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.714 18:10:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.714 18:10:17 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:08.714 18:10:17 -- nvmf/common.sh@717 -- # local ip 00:22:08.714 18:10:17 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:08.714 18:10:17 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:08.714 18:10:17 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:08.714 18:10:17 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:08.714 18:10:17 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:08.714 18:10:17 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:08.972 18:10:17 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:08.972 18:10:17 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:08.972 18:10:17 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:08.972 18:10:17 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:08.972 18:10:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.972 18:10:17 -- common/autotest_common.sh@10 -- # set +x 00:22:08.972 nvme0n1 00:22:08.972 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.972 18:10:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:08.972 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.972 18:10:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:08.972 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:08.972 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.972 18:10:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:08.972 18:10:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:08.972 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:08.972 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:08.972 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:08.972 18:10:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:08.972 18:10:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 2 00:22:08.972 18:10:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:08.972 18:10:18 -- host/auth.sh@44 -- # digest=sha512 00:22:09.229 18:10:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:09.229 18:10:18 -- host/auth.sh@44 -- # keyid=2 00:22:09.229 18:10:18 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:09.229 18:10:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:09.229 18:10:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:09.229 18:10:18 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:09.229 18:10:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 2 00:22:09.229 18:10:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:09.229 18:10:18 -- host/auth.sh@68 -- # digest=sha512 00:22:09.229 18:10:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:09.229 18:10:18 -- host/auth.sh@68 -- # keyid=2 00:22:09.229 18:10:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:09.229 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.229 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.229 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.229 18:10:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:09.229 18:10:18 -- nvmf/common.sh@717 -- # local ip 00:22:09.229 18:10:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:09.229 18:10:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:09.229 18:10:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:09.229 18:10:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:09.229 18:10:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:09.229 18:10:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:09.229 18:10:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:09.229 18:10:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:09.229 18:10:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:09.229 18:10:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:09.229 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.229 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.229 nvme0n1 00:22:09.229 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.229 18:10:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.229 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.229 18:10:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:09.229 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.229 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.229 18:10:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:09.229 18:10:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:09.229 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.229 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.487 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.487 18:10:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:09.487 18:10:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 3 00:22:09.487 18:10:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:09.487 18:10:18 -- host/auth.sh@44 -- # digest=sha512 00:22:09.487 18:10:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:09.487 18:10:18 -- host/auth.sh@44 -- # keyid=3 00:22:09.487 18:10:18 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:09.487 18:10:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:09.487 18:10:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:09.487 18:10:18 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:09.487 18:10:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 3 00:22:09.487 18:10:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:09.487 18:10:18 -- host/auth.sh@68 -- # digest=sha512 00:22:09.487 18:10:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:09.487 18:10:18 -- host/auth.sh@68 -- # keyid=3 00:22:09.487 18:10:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:09.487 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.487 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.487 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.487 18:10:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:09.487 18:10:18 -- nvmf/common.sh@717 -- # local ip 00:22:09.487 18:10:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:09.487 18:10:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:09.487 18:10:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:09.487 18:10:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:09.487 18:10:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:09.487 18:10:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:09.487 18:10:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:09.487 18:10:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:09.487 18:10:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:09.487 18:10:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:09.487 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.487 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.487 nvme0n1 00:22:09.487 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.487 18:10:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.487 18:10:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:09.487 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.487 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.487 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.487 18:10:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:09.487 18:10:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:09.487 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.487 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.746 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.746 18:10:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:09.746 18:10:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe2048 4 00:22:09.746 18:10:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:09.746 18:10:18 -- host/auth.sh@44 -- # digest=sha512 00:22:09.746 18:10:18 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:09.746 18:10:18 -- host/auth.sh@44 -- # keyid=4 00:22:09.746 18:10:18 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:09.746 18:10:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:09.746 18:10:18 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:09.746 18:10:18 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:09.746 18:10:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe2048 4 00:22:09.746 18:10:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:09.746 18:10:18 -- host/auth.sh@68 -- # digest=sha512 00:22:09.746 18:10:18 -- host/auth.sh@68 -- # dhgroup=ffdhe2048 00:22:09.746 18:10:18 -- host/auth.sh@68 -- # keyid=4 00:22:09.746 18:10:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe2048 00:22:09.746 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.746 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.746 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.746 18:10:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:09.746 18:10:18 -- nvmf/common.sh@717 -- # local ip 00:22:09.746 18:10:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:09.746 18:10:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:09.746 18:10:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:09.746 18:10:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:09.746 18:10:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:09.746 18:10:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:09.746 18:10:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:09.746 18:10:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:09.746 18:10:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:09.746 18:10:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:09.746 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.746 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.746 nvme0n1 00:22:09.746 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.746 18:10:18 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:09.746 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.746 18:10:18 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:09.746 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:09.746 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:09.746 18:10:18 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:09.746 18:10:18 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:09.746 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:09.746 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:10.005 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.005 18:10:18 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:10.005 18:10:18 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:10.005 18:10:18 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 0 00:22:10.005 18:10:18 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:10.005 18:10:18 -- host/auth.sh@44 -- # digest=sha512 00:22:10.005 18:10:18 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:10.005 18:10:18 -- host/auth.sh@44 -- # keyid=0 00:22:10.005 18:10:18 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:10.005 18:10:18 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:10.005 18:10:18 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:10.005 18:10:18 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:10.005 18:10:18 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 0 00:22:10.005 18:10:18 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:10.005 18:10:18 -- host/auth.sh@68 -- # digest=sha512 00:22:10.005 18:10:18 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:10.005 18:10:18 -- host/auth.sh@68 -- # keyid=0 00:22:10.005 18:10:18 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:10.005 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.005 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:10.005 18:10:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.005 18:10:18 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:10.005 18:10:18 -- nvmf/common.sh@717 -- # local ip 00:22:10.005 18:10:18 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:10.005 18:10:18 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:10.005 18:10:18 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:10.005 18:10:18 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:10.005 18:10:18 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:10.005 18:10:18 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:10.005 18:10:18 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:10.005 18:10:18 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:10.005 18:10:18 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:10.005 18:10:18 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:10.005 18:10:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.005 18:10:18 -- common/autotest_common.sh@10 -- # set +x 00:22:10.005 nvme0n1 00:22:10.005 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.005 18:10:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:10.005 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.005 18:10:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:10.005 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.005 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.263 18:10:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:10.264 18:10:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:10.264 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.264 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.264 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.264 18:10:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:10.264 18:10:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 1 00:22:10.264 18:10:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:10.264 18:10:19 -- host/auth.sh@44 -- # digest=sha512 00:22:10.264 18:10:19 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:10.264 18:10:19 -- host/auth.sh@44 -- # keyid=1 00:22:10.264 18:10:19 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:10.264 18:10:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:10.264 18:10:19 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:10.264 18:10:19 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:10.264 18:10:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 1 00:22:10.264 18:10:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:10.264 18:10:19 -- host/auth.sh@68 -- # digest=sha512 00:22:10.264 18:10:19 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:10.264 18:10:19 -- host/auth.sh@68 -- # keyid=1 00:22:10.264 18:10:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:10.264 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.264 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.264 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.264 18:10:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:10.264 18:10:19 -- nvmf/common.sh@717 -- # local ip 00:22:10.264 18:10:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:10.264 18:10:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:10.264 18:10:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:10.264 18:10:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:10.264 18:10:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:10.264 18:10:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:10.264 18:10:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:10.264 18:10:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:10.264 18:10:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:10.264 18:10:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:10.264 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.264 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.522 nvme0n1 00:22:10.522 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.522 18:10:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:10.522 18:10:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:10.522 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.522 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.522 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.522 18:10:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:10.522 18:10:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:10.522 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.522 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.522 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.522 18:10:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:10.522 18:10:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 2 00:22:10.522 18:10:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:10.522 18:10:19 -- host/auth.sh@44 -- # digest=sha512 00:22:10.522 18:10:19 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:10.522 18:10:19 -- host/auth.sh@44 -- # keyid=2 00:22:10.522 18:10:19 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:10.522 18:10:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:10.522 18:10:19 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:10.522 18:10:19 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:10.522 18:10:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 2 00:22:10.522 18:10:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:10.522 18:10:19 -- host/auth.sh@68 -- # digest=sha512 00:22:10.522 18:10:19 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:10.522 18:10:19 -- host/auth.sh@68 -- # keyid=2 00:22:10.522 18:10:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:10.522 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.522 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.522 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.522 18:10:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:10.522 18:10:19 -- nvmf/common.sh@717 -- # local ip 00:22:10.522 18:10:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:10.522 18:10:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:10.522 18:10:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:10.522 18:10:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:10.522 18:10:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:10.522 18:10:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:10.522 18:10:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:10.522 18:10:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:10.522 18:10:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:10.522 18:10:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:10.522 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.522 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.781 nvme0n1 00:22:10.781 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.781 18:10:19 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:10.781 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.781 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.781 18:10:19 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:10.781 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.781 18:10:19 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:10.781 18:10:19 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:10.781 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.781 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.781 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.781 18:10:19 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:10.781 18:10:19 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 3 00:22:10.781 18:10:19 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:10.781 18:10:19 -- host/auth.sh@44 -- # digest=sha512 00:22:10.781 18:10:19 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:10.781 18:10:19 -- host/auth.sh@44 -- # keyid=3 00:22:10.781 18:10:19 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:10.781 18:10:19 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:10.781 18:10:19 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:10.781 18:10:19 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:10.781 18:10:19 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 3 00:22:10.781 18:10:19 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:10.781 18:10:19 -- host/auth.sh@68 -- # digest=sha512 00:22:10.781 18:10:19 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:10.781 18:10:19 -- host/auth.sh@68 -- # keyid=3 00:22:10.781 18:10:19 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:10.781 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.781 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:10.781 18:10:19 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:10.781 18:10:19 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:10.781 18:10:19 -- nvmf/common.sh@717 -- # local ip 00:22:10.781 18:10:19 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:10.781 18:10:19 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:10.781 18:10:19 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:10.781 18:10:19 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:10.781 18:10:19 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:10.781 18:10:19 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:10.781 18:10:19 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:10.781 18:10:19 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:10.781 18:10:19 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:10.781 18:10:19 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:10.781 18:10:19 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:10.781 18:10:19 -- common/autotest_common.sh@10 -- # set +x 00:22:11.039 nvme0n1 00:22:11.039 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.039 18:10:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:11.039 18:10:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:11.039 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.039 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.039 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.039 18:10:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:11.039 18:10:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:11.039 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.039 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.039 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.039 18:10:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:11.039 18:10:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe3072 4 00:22:11.039 18:10:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:11.039 18:10:20 -- host/auth.sh@44 -- # digest=sha512 00:22:11.039 18:10:20 -- host/auth.sh@44 -- # dhgroup=ffdhe3072 00:22:11.039 18:10:20 -- host/auth.sh@44 -- # keyid=4 00:22:11.039 18:10:20 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:11.039 18:10:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:11.039 18:10:20 -- host/auth.sh@48 -- # echo ffdhe3072 00:22:11.039 18:10:20 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:11.039 18:10:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe3072 4 00:22:11.039 18:10:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:11.039 18:10:20 -- host/auth.sh@68 -- # digest=sha512 00:22:11.039 18:10:20 -- host/auth.sh@68 -- # dhgroup=ffdhe3072 00:22:11.039 18:10:20 -- host/auth.sh@68 -- # keyid=4 00:22:11.039 18:10:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe3072 00:22:11.039 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.040 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.040 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.040 18:10:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:11.040 18:10:20 -- nvmf/common.sh@717 -- # local ip 00:22:11.040 18:10:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:11.040 18:10:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:11.040 18:10:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:11.040 18:10:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:11.040 18:10:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:11.040 18:10:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:11.040 18:10:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:11.040 18:10:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:11.040 18:10:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:11.040 18:10:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:11.040 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.040 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.298 nvme0n1 00:22:11.298 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.298 18:10:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:11.298 18:10:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:11.298 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.298 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.298 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.298 18:10:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:11.298 18:10:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:11.298 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.298 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.298 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.298 18:10:20 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:11.298 18:10:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:11.298 18:10:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 0 00:22:11.298 18:10:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:11.298 18:10:20 -- host/auth.sh@44 -- # digest=sha512 00:22:11.298 18:10:20 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:11.298 18:10:20 -- host/auth.sh@44 -- # keyid=0 00:22:11.298 18:10:20 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:11.298 18:10:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:11.298 18:10:20 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:11.298 18:10:20 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:11.298 18:10:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 0 00:22:11.298 18:10:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:11.298 18:10:20 -- host/auth.sh@68 -- # digest=sha512 00:22:11.298 18:10:20 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:11.298 18:10:20 -- host/auth.sh@68 -- # keyid=0 00:22:11.298 18:10:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:11.298 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.298 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.298 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.298 18:10:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:11.298 18:10:20 -- nvmf/common.sh@717 -- # local ip 00:22:11.298 18:10:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:11.298 18:10:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:11.298 18:10:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:11.298 18:10:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:11.298 18:10:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:11.299 18:10:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:11.299 18:10:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:11.299 18:10:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:11.299 18:10:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:11.299 18:10:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:11.299 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.299 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.557 nvme0n1 00:22:11.557 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.557 18:10:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:11.557 18:10:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:11.557 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.557 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.557 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.557 18:10:20 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:11.557 18:10:20 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:11.557 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.557 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.557 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.557 18:10:20 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:11.557 18:10:20 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 1 00:22:11.557 18:10:20 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:11.557 18:10:20 -- host/auth.sh@44 -- # digest=sha512 00:22:11.557 18:10:20 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:11.557 18:10:20 -- host/auth.sh@44 -- # keyid=1 00:22:11.557 18:10:20 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:11.557 18:10:20 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:11.557 18:10:20 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:11.557 18:10:20 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:11.557 18:10:20 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 1 00:22:11.557 18:10:20 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:11.557 18:10:20 -- host/auth.sh@68 -- # digest=sha512 00:22:11.557 18:10:20 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:11.557 18:10:20 -- host/auth.sh@68 -- # keyid=1 00:22:11.557 18:10:20 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:11.557 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.557 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.557 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.557 18:10:20 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:11.557 18:10:20 -- nvmf/common.sh@717 -- # local ip 00:22:11.557 18:10:20 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:11.557 18:10:20 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:11.557 18:10:20 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:11.557 18:10:20 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:11.557 18:10:20 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:11.557 18:10:20 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:11.557 18:10:20 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:11.557 18:10:20 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:11.557 18:10:20 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:11.557 18:10:20 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:11.557 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.557 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.815 nvme0n1 00:22:11.815 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:11.815 18:10:20 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:11.815 18:10:20 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:11.815 18:10:20 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:11.815 18:10:20 -- common/autotest_common.sh@10 -- # set +x 00:22:11.815 18:10:20 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.073 18:10:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:12.073 18:10:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:12.073 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.074 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.074 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.074 18:10:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:12.074 18:10:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 2 00:22:12.074 18:10:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:12.074 18:10:21 -- host/auth.sh@44 -- # digest=sha512 00:22:12.074 18:10:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:12.074 18:10:21 -- host/auth.sh@44 -- # keyid=2 00:22:12.074 18:10:21 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:12.074 18:10:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:12.074 18:10:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:12.074 18:10:21 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:12.074 18:10:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 2 00:22:12.074 18:10:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:12.074 18:10:21 -- host/auth.sh@68 -- # digest=sha512 00:22:12.074 18:10:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:12.074 18:10:21 -- host/auth.sh@68 -- # keyid=2 00:22:12.074 18:10:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:12.074 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.074 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.074 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.074 18:10:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:12.074 18:10:21 -- nvmf/common.sh@717 -- # local ip 00:22:12.074 18:10:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:12.074 18:10:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:12.074 18:10:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:12.074 18:10:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:12.074 18:10:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:12.074 18:10:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:12.074 18:10:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:12.074 18:10:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:12.074 18:10:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:12.074 18:10:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:12.074 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.074 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.333 nvme0n1 00:22:12.333 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.333 18:10:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:12.333 18:10:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:12.333 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.333 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.333 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.333 18:10:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:12.333 18:10:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:12.333 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.333 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.333 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.333 18:10:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:12.333 18:10:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 3 00:22:12.333 18:10:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:12.333 18:10:21 -- host/auth.sh@44 -- # digest=sha512 00:22:12.333 18:10:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:12.333 18:10:21 -- host/auth.sh@44 -- # keyid=3 00:22:12.333 18:10:21 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:12.333 18:10:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:12.333 18:10:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:12.333 18:10:21 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:12.333 18:10:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 3 00:22:12.333 18:10:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:12.333 18:10:21 -- host/auth.sh@68 -- # digest=sha512 00:22:12.333 18:10:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:12.333 18:10:21 -- host/auth.sh@68 -- # keyid=3 00:22:12.333 18:10:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:12.333 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.333 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.333 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.333 18:10:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:12.333 18:10:21 -- nvmf/common.sh@717 -- # local ip 00:22:12.333 18:10:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:12.333 18:10:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:12.333 18:10:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:12.333 18:10:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:12.333 18:10:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:12.333 18:10:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:12.333 18:10:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:12.333 18:10:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:12.333 18:10:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:12.333 18:10:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:12.333 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.333 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.592 nvme0n1 00:22:12.592 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.592 18:10:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:12.592 18:10:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:12.592 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.592 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.592 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.592 18:10:21 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:12.592 18:10:21 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:12.592 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.592 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.592 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.592 18:10:21 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:12.592 18:10:21 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe4096 4 00:22:12.592 18:10:21 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:12.592 18:10:21 -- host/auth.sh@44 -- # digest=sha512 00:22:12.592 18:10:21 -- host/auth.sh@44 -- # dhgroup=ffdhe4096 00:22:12.592 18:10:21 -- host/auth.sh@44 -- # keyid=4 00:22:12.592 18:10:21 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:12.592 18:10:21 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:12.592 18:10:21 -- host/auth.sh@48 -- # echo ffdhe4096 00:22:12.592 18:10:21 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:12.592 18:10:21 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe4096 4 00:22:12.592 18:10:21 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:12.592 18:10:21 -- host/auth.sh@68 -- # digest=sha512 00:22:12.592 18:10:21 -- host/auth.sh@68 -- # dhgroup=ffdhe4096 00:22:12.592 18:10:21 -- host/auth.sh@68 -- # keyid=4 00:22:12.592 18:10:21 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe4096 00:22:12.592 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.592 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.592 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.592 18:10:21 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:12.592 18:10:21 -- nvmf/common.sh@717 -- # local ip 00:22:12.592 18:10:21 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:12.592 18:10:21 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:12.592 18:10:21 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:12.592 18:10:21 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:12.592 18:10:21 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:12.592 18:10:21 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:12.592 18:10:21 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:12.592 18:10:21 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:12.592 18:10:21 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:12.592 18:10:21 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:12.592 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.592 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.850 nvme0n1 00:22:12.850 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.850 18:10:21 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:12.850 18:10:21 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.850 18:10:21 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:12.850 18:10:21 -- common/autotest_common.sh@10 -- # set +x 00:22:12.850 18:10:21 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.850 18:10:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:12.850 18:10:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:12.850 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.850 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:12.850 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:12.850 18:10:22 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:12.850 18:10:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:12.850 18:10:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 0 00:22:12.850 18:10:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:12.850 18:10:22 -- host/auth.sh@44 -- # digest=sha512 00:22:12.850 18:10:22 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:12.850 18:10:22 -- host/auth.sh@44 -- # keyid=0 00:22:12.850 18:10:22 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:12.850 18:10:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:12.850 18:10:22 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:12.850 18:10:22 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:12.850 18:10:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 0 00:22:12.850 18:10:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:12.850 18:10:22 -- host/auth.sh@68 -- # digest=sha512 00:22:12.850 18:10:22 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:12.850 18:10:22 -- host/auth.sh@68 -- # keyid=0 00:22:12.850 18:10:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:12.850 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:12.850 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.109 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.109 18:10:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:13.109 18:10:22 -- nvmf/common.sh@717 -- # local ip 00:22:13.109 18:10:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:13.109 18:10:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:13.109 18:10:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:13.109 18:10:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:13.109 18:10:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:13.109 18:10:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:13.109 18:10:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:13.109 18:10:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:13.109 18:10:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:13.109 18:10:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:13.109 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.109 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.368 nvme0n1 00:22:13.368 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.368 18:10:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:13.368 18:10:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:13.368 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.368 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.368 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.368 18:10:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:13.368 18:10:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:13.368 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.368 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.368 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.368 18:10:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:13.368 18:10:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 1 00:22:13.368 18:10:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:13.368 18:10:22 -- host/auth.sh@44 -- # digest=sha512 00:22:13.368 18:10:22 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:13.368 18:10:22 -- host/auth.sh@44 -- # keyid=1 00:22:13.368 18:10:22 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:13.368 18:10:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:13.368 18:10:22 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:13.368 18:10:22 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:13.368 18:10:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 1 00:22:13.368 18:10:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:13.368 18:10:22 -- host/auth.sh@68 -- # digest=sha512 00:22:13.368 18:10:22 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:13.368 18:10:22 -- host/auth.sh@68 -- # keyid=1 00:22:13.368 18:10:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:13.368 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.368 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.368 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.368 18:10:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:13.368 18:10:22 -- nvmf/common.sh@717 -- # local ip 00:22:13.368 18:10:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:13.368 18:10:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:13.368 18:10:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:13.368 18:10:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:13.368 18:10:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:13.368 18:10:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:13.368 18:10:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:13.368 18:10:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:13.368 18:10:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:13.368 18:10:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:13.368 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.368 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 nvme0n1 00:22:13.935 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.935 18:10:22 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:13.935 18:10:22 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:13.935 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.935 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.935 18:10:22 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:13.935 18:10:22 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:13.935 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.935 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.935 18:10:22 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:13.935 18:10:22 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 2 00:22:13.935 18:10:22 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:13.935 18:10:22 -- host/auth.sh@44 -- # digest=sha512 00:22:13.935 18:10:22 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:13.935 18:10:22 -- host/auth.sh@44 -- # keyid=2 00:22:13.935 18:10:22 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:13.935 18:10:22 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:13.935 18:10:22 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:13.935 18:10:22 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:13.935 18:10:22 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 2 00:22:13.935 18:10:22 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:13.935 18:10:22 -- host/auth.sh@68 -- # digest=sha512 00:22:13.935 18:10:22 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:13.935 18:10:22 -- host/auth.sh@68 -- # keyid=2 00:22:13.935 18:10:22 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:13.935 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.935 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:13.935 18:10:22 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:13.935 18:10:22 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:13.935 18:10:22 -- nvmf/common.sh@717 -- # local ip 00:22:13.935 18:10:22 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:13.935 18:10:22 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:13.935 18:10:22 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:13.935 18:10:22 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:13.935 18:10:22 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:13.935 18:10:22 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:13.935 18:10:22 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:13.935 18:10:22 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:13.935 18:10:22 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:13.935 18:10:22 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:13.935 18:10:22 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:13.935 18:10:22 -- common/autotest_common.sh@10 -- # set +x 00:22:14.193 nvme0n1 00:22:14.193 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.193 18:10:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:14.193 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.193 18:10:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:14.193 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.193 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.193 18:10:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:14.193 18:10:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:14.193 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.193 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.450 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.450 18:10:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:14.450 18:10:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 3 00:22:14.450 18:10:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:14.450 18:10:23 -- host/auth.sh@44 -- # digest=sha512 00:22:14.450 18:10:23 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:14.450 18:10:23 -- host/auth.sh@44 -- # keyid=3 00:22:14.450 18:10:23 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:14.450 18:10:23 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:14.450 18:10:23 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:14.450 18:10:23 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:14.450 18:10:23 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 3 00:22:14.450 18:10:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:14.450 18:10:23 -- host/auth.sh@68 -- # digest=sha512 00:22:14.450 18:10:23 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:14.450 18:10:23 -- host/auth.sh@68 -- # keyid=3 00:22:14.450 18:10:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:14.450 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.450 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.450 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.450 18:10:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:14.450 18:10:23 -- nvmf/common.sh@717 -- # local ip 00:22:14.450 18:10:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:14.450 18:10:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:14.450 18:10:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:14.450 18:10:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:14.450 18:10:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:14.450 18:10:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:14.450 18:10:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:14.450 18:10:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:14.450 18:10:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:14.450 18:10:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:14.450 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.450 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.707 nvme0n1 00:22:14.707 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.707 18:10:23 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:14.707 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.707 18:10:23 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:14.707 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.707 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.707 18:10:23 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:14.707 18:10:23 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:14.707 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.707 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.707 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.707 18:10:23 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:14.707 18:10:23 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe6144 4 00:22:14.707 18:10:23 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:14.707 18:10:23 -- host/auth.sh@44 -- # digest=sha512 00:22:14.707 18:10:23 -- host/auth.sh@44 -- # dhgroup=ffdhe6144 00:22:14.707 18:10:23 -- host/auth.sh@44 -- # keyid=4 00:22:14.707 18:10:23 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:14.707 18:10:23 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:14.707 18:10:23 -- host/auth.sh@48 -- # echo ffdhe6144 00:22:14.707 18:10:23 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:14.707 18:10:23 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe6144 4 00:22:14.707 18:10:23 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:14.708 18:10:23 -- host/auth.sh@68 -- # digest=sha512 00:22:14.708 18:10:23 -- host/auth.sh@68 -- # dhgroup=ffdhe6144 00:22:14.708 18:10:23 -- host/auth.sh@68 -- # keyid=4 00:22:14.708 18:10:23 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe6144 00:22:14.708 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.708 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:14.708 18:10:23 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:14.708 18:10:23 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:14.708 18:10:23 -- nvmf/common.sh@717 -- # local ip 00:22:14.708 18:10:23 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:14.708 18:10:23 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:14.708 18:10:23 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:14.708 18:10:23 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:14.708 18:10:23 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:14.708 18:10:23 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:14.708 18:10:23 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:14.708 18:10:23 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:14.708 18:10:23 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:14.708 18:10:23 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:14.708 18:10:23 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:14.708 18:10:23 -- common/autotest_common.sh@10 -- # set +x 00:22:15.272 nvme0n1 00:22:15.272 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.272 18:10:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:15.272 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.272 18:10:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:15.272 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.272 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.272 18:10:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:15.272 18:10:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:15.272 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.272 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.272 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.272 18:10:24 -- host/auth.sh@108 -- # for dhgroup in "${dhgroups[@]}" 00:22:15.272 18:10:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:15.272 18:10:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 0 00:22:15.272 18:10:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:15.272 18:10:24 -- host/auth.sh@44 -- # digest=sha512 00:22:15.272 18:10:24 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:15.272 18:10:24 -- host/auth.sh@44 -- # keyid=0 00:22:15.272 18:10:24 -- host/auth.sh@45 -- # key=DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:15.272 18:10:24 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:15.272 18:10:24 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:15.272 18:10:24 -- host/auth.sh@49 -- # echo DHHC-1:00:MzA0ZmVmZjBkNjVjMWMyYjY1ZDI5YjQ0OTcyYmZkMjIaPAiT: 00:22:15.272 18:10:24 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 0 00:22:15.272 18:10:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:15.272 18:10:24 -- host/auth.sh@68 -- # digest=sha512 00:22:15.272 18:10:24 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:15.272 18:10:24 -- host/auth.sh@68 -- # keyid=0 00:22:15.272 18:10:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:15.272 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.272 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.272 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.272 18:10:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:15.272 18:10:24 -- nvmf/common.sh@717 -- # local ip 00:22:15.272 18:10:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:15.272 18:10:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:15.272 18:10:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:15.272 18:10:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:15.272 18:10:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:15.272 18:10:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:15.272 18:10:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:15.272 18:10:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:15.272 18:10:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:15.272 18:10:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key0 00:22:15.272 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.272 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.837 nvme0n1 00:22:15.837 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.837 18:10:24 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:15.837 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.837 18:10:24 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:15.837 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.837 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.837 18:10:24 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:15.837 18:10:24 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:15.837 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.837 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.837 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.837 18:10:24 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:15.837 18:10:24 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 1 00:22:15.837 18:10:24 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:15.837 18:10:24 -- host/auth.sh@44 -- # digest=sha512 00:22:15.837 18:10:24 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:15.837 18:10:24 -- host/auth.sh@44 -- # keyid=1 00:22:15.837 18:10:24 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:15.837 18:10:24 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:15.837 18:10:24 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:15.837 18:10:24 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:15.837 18:10:24 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 1 00:22:15.837 18:10:24 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:15.837 18:10:24 -- host/auth.sh@68 -- # digest=sha512 00:22:15.837 18:10:24 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:15.837 18:10:24 -- host/auth.sh@68 -- # keyid=1 00:22:15.837 18:10:24 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:15.837 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.837 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:15.837 18:10:24 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:15.837 18:10:24 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:15.837 18:10:24 -- nvmf/common.sh@717 -- # local ip 00:22:15.837 18:10:24 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:15.837 18:10:24 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:15.837 18:10:24 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:15.837 18:10:24 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:15.837 18:10:24 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:15.837 18:10:24 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:15.837 18:10:24 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:15.837 18:10:24 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:15.837 18:10:24 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:15.837 18:10:24 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key1 00:22:15.837 18:10:24 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:15.837 18:10:24 -- common/autotest_common.sh@10 -- # set +x 00:22:16.403 nvme0n1 00:22:16.403 18:10:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:16.403 18:10:25 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:16.403 18:10:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:16.403 18:10:25 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:16.403 18:10:25 -- common/autotest_common.sh@10 -- # set +x 00:22:16.403 18:10:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:16.403 18:10:25 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:16.403 18:10:25 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:16.403 18:10:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:16.403 18:10:25 -- common/autotest_common.sh@10 -- # set +x 00:22:16.403 18:10:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:16.403 18:10:25 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:16.403 18:10:25 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 2 00:22:16.403 18:10:25 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:16.403 18:10:25 -- host/auth.sh@44 -- # digest=sha512 00:22:16.403 18:10:25 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:16.403 18:10:25 -- host/auth.sh@44 -- # keyid=2 00:22:16.403 18:10:25 -- host/auth.sh@45 -- # key=DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:16.403 18:10:25 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:16.403 18:10:25 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:16.403 18:10:25 -- host/auth.sh@49 -- # echo DHHC-1:01:ODI4YjA5YTJiYjViZjY2Y2Q4NTQwYjM1ZDUzMWZjYjl+K+oY: 00:22:16.403 18:10:25 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 2 00:22:16.403 18:10:25 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:16.403 18:10:25 -- host/auth.sh@68 -- # digest=sha512 00:22:16.403 18:10:25 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:16.403 18:10:25 -- host/auth.sh@68 -- # keyid=2 00:22:16.403 18:10:25 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:16.403 18:10:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:16.403 18:10:25 -- common/autotest_common.sh@10 -- # set +x 00:22:16.403 18:10:25 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:16.403 18:10:25 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:16.403 18:10:25 -- nvmf/common.sh@717 -- # local ip 00:22:16.403 18:10:25 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:16.403 18:10:25 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:16.403 18:10:25 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:16.403 18:10:25 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:16.403 18:10:25 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:16.403 18:10:25 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:16.403 18:10:25 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:16.403 18:10:25 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:16.403 18:10:25 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:16.403 18:10:25 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:16.403 18:10:25 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:16.403 18:10:25 -- common/autotest_common.sh@10 -- # set +x 00:22:16.967 nvme0n1 00:22:16.967 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:16.967 18:10:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:16.967 18:10:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:16.967 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:16.967 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.225 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.225 18:10:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:17.225 18:10:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:17.225 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.225 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.225 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.225 18:10:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:17.225 18:10:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 3 00:22:17.225 18:10:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:17.225 18:10:26 -- host/auth.sh@44 -- # digest=sha512 00:22:17.225 18:10:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:17.225 18:10:26 -- host/auth.sh@44 -- # keyid=3 00:22:17.225 18:10:26 -- host/auth.sh@45 -- # key=DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:17.225 18:10:26 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:17.225 18:10:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:17.225 18:10:26 -- host/auth.sh@49 -- # echo DHHC-1:02:MzRjNzJlMDEzZjI1NzU1ZTQyOGU4YjU3NmM4MTJjMjdkMWQ3MmZjY2EzODhjYTZiUNEVlQ==: 00:22:17.225 18:10:26 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 3 00:22:17.225 18:10:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:17.225 18:10:26 -- host/auth.sh@68 -- # digest=sha512 00:22:17.225 18:10:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:17.225 18:10:26 -- host/auth.sh@68 -- # keyid=3 00:22:17.225 18:10:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:17.225 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.225 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.225 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.225 18:10:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:17.225 18:10:26 -- nvmf/common.sh@717 -- # local ip 00:22:17.225 18:10:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:17.225 18:10:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:17.225 18:10:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:17.225 18:10:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:17.225 18:10:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:17.225 18:10:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:17.225 18:10:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:17.225 18:10:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:17.225 18:10:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:17.225 18:10:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key3 00:22:17.225 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.225 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.789 nvme0n1 00:22:17.789 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.789 18:10:26 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:17.789 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.789 18:10:26 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:17.789 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.789 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.789 18:10:26 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:17.789 18:10:26 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:17.789 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.789 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.789 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.789 18:10:26 -- host/auth.sh@109 -- # for keyid in "${!keys[@]}" 00:22:17.789 18:10:26 -- host/auth.sh@110 -- # nvmet_auth_set_key sha512 ffdhe8192 4 00:22:17.789 18:10:26 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:17.789 18:10:26 -- host/auth.sh@44 -- # digest=sha512 00:22:17.789 18:10:26 -- host/auth.sh@44 -- # dhgroup=ffdhe8192 00:22:17.789 18:10:26 -- host/auth.sh@44 -- # keyid=4 00:22:17.789 18:10:26 -- host/auth.sh@45 -- # key=DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:17.789 18:10:26 -- host/auth.sh@47 -- # echo 'hmac(sha512)' 00:22:17.789 18:10:26 -- host/auth.sh@48 -- # echo ffdhe8192 00:22:17.789 18:10:26 -- host/auth.sh@49 -- # echo DHHC-1:03:OTc2Y2Q2ZDlkYjEyMWZiMWRkNDk2NjY4NjVkODkzNTJhNTc5ODZhMzUzOWMzNzU0YTEyNjgxNzgzYjkyNDI2OS91MKE=: 00:22:17.789 18:10:26 -- host/auth.sh@111 -- # connect_authenticate sha512 ffdhe8192 4 00:22:17.789 18:10:26 -- host/auth.sh@66 -- # local digest dhgroup keyid 00:22:17.789 18:10:26 -- host/auth.sh@68 -- # digest=sha512 00:22:17.789 18:10:26 -- host/auth.sh@68 -- # dhgroup=ffdhe8192 00:22:17.789 18:10:26 -- host/auth.sh@68 -- # keyid=4 00:22:17.789 18:10:26 -- host/auth.sh@69 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha512 --dhchap-dhgroups ffdhe8192 00:22:17.789 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.789 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:17.789 18:10:26 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:17.789 18:10:26 -- host/auth.sh@70 -- # get_main_ns_ip 00:22:17.789 18:10:26 -- nvmf/common.sh@717 -- # local ip 00:22:17.789 18:10:26 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:17.789 18:10:26 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:17.789 18:10:26 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:17.789 18:10:26 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:17.789 18:10:26 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:17.789 18:10:26 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:17.789 18:10:26 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:17.789 18:10:26 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:17.789 18:10:26 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:17.789 18:10:26 -- host/auth.sh@70 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key4 00:22:17.789 18:10:26 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:17.789 18:10:26 -- common/autotest_common.sh@10 -- # set +x 00:22:18.354 nvme0n1 00:22:18.354 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.354 18:10:27 -- host/auth.sh@73 -- # rpc_cmd bdev_nvme_get_controllers 00:22:18.354 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.354 18:10:27 -- host/auth.sh@73 -- # jq -r '.[].name' 00:22:18.354 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.354 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.354 18:10:27 -- host/auth.sh@73 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:22:18.354 18:10:27 -- host/auth.sh@74 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:22:18.354 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.354 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.354 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.354 18:10:27 -- host/auth.sh@117 -- # nvmet_auth_set_key sha256 ffdhe2048 1 00:22:18.354 18:10:27 -- host/auth.sh@42 -- # local digest dhgroup keyid key 00:22:18.354 18:10:27 -- host/auth.sh@44 -- # digest=sha256 00:22:18.354 18:10:27 -- host/auth.sh@44 -- # dhgroup=ffdhe2048 00:22:18.354 18:10:27 -- host/auth.sh@44 -- # keyid=1 00:22:18.354 18:10:27 -- host/auth.sh@45 -- # key=DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:18.354 18:10:27 -- host/auth.sh@47 -- # echo 'hmac(sha256)' 00:22:18.354 18:10:27 -- host/auth.sh@48 -- # echo ffdhe2048 00:22:18.354 18:10:27 -- host/auth.sh@49 -- # echo DHHC-1:00:ODYzZGU4ZWU4OGUwZWU0NDkxYTg4MzhjNGMxMWY1YjQ2ZThmYjdjMjdhODJlYzMxkUknOw==: 00:22:18.354 18:10:27 -- host/auth.sh@118 -- # rpc_cmd bdev_nvme_set_options --dhchap-digests sha256 --dhchap-dhgroups ffdhe2048 00:22:18.354 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.354 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.354 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.354 18:10:27 -- host/auth.sh@119 -- # get_main_ns_ip 00:22:18.354 18:10:27 -- nvmf/common.sh@717 -- # local ip 00:22:18.354 18:10:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:18.354 18:10:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:18.354 18:10:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:18.354 18:10:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:18.354 18:10:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:18.354 18:10:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:18.354 18:10:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:18.354 18:10:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:18.354 18:10:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:18.354 18:10:27 -- host/auth.sh@119 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:18.354 18:10:27 -- common/autotest_common.sh@648 -- # local es=0 00:22:18.354 18:10:27 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:18.354 18:10:27 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:22:18.354 18:10:27 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:22:18.354 18:10:27 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:22:18.354 18:10:27 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:22:18.354 18:10:27 -- common/autotest_common.sh@651 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 00:22:18.354 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.354 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.613 request: 00:22:18.613 { 00:22:18.613 "name": "nvme0", 00:22:18.613 "trtype": "rdma", 00:22:18.613 "traddr": "192.168.100.8", 00:22:18.613 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:22:18.613 "adrfam": "ipv4", 00:22:18.613 "trsvcid": "4420", 00:22:18.613 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:22:18.613 "method": "bdev_nvme_attach_controller", 00:22:18.613 "req_id": 1 00:22:18.613 } 00:22:18.613 Got JSON-RPC error response 00:22:18.613 response: 00:22:18.613 { 00:22:18.613 "code": -32602, 00:22:18.613 "message": "Invalid parameters" 00:22:18.613 } 00:22:18.613 18:10:27 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:22:18.613 18:10:27 -- common/autotest_common.sh@651 -- # es=1 00:22:18.613 18:10:27 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:22:18.613 18:10:27 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:22:18.613 18:10:27 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:22:18.613 18:10:27 -- host/auth.sh@121 -- # rpc_cmd bdev_nvme_get_controllers 00:22:18.613 18:10:27 -- host/auth.sh@121 -- # jq length 00:22:18.613 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.613 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.613 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.613 18:10:27 -- host/auth.sh@121 -- # (( 0 == 0 )) 00:22:18.613 18:10:27 -- host/auth.sh@124 -- # get_main_ns_ip 00:22:18.613 18:10:27 -- nvmf/common.sh@717 -- # local ip 00:22:18.613 18:10:27 -- nvmf/common.sh@718 -- # ip_candidates=() 00:22:18.613 18:10:27 -- nvmf/common.sh@718 -- # local -A ip_candidates 00:22:18.613 18:10:27 -- nvmf/common.sh@720 -- # ip_candidates["rdma"]=NVMF_FIRST_TARGET_IP 00:22:18.613 18:10:27 -- nvmf/common.sh@721 -- # ip_candidates["tcp"]=NVMF_INITIATOR_IP 00:22:18.613 18:10:27 -- nvmf/common.sh@723 -- # [[ -z rdma ]] 00:22:18.613 18:10:27 -- nvmf/common.sh@723 -- # [[ -z NVMF_FIRST_TARGET_IP ]] 00:22:18.613 18:10:27 -- nvmf/common.sh@724 -- # ip=NVMF_FIRST_TARGET_IP 00:22:18.613 18:10:27 -- nvmf/common.sh@726 -- # [[ -z 192.168.100.8 ]] 00:22:18.613 18:10:27 -- nvmf/common.sh@731 -- # echo 192.168.100.8 00:22:18.613 18:10:27 -- host/auth.sh@124 -- # NOT rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:18.613 18:10:27 -- common/autotest_common.sh@648 -- # local es=0 00:22:18.613 18:10:27 -- common/autotest_common.sh@650 -- # valid_exec_arg rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:18.613 18:10:27 -- common/autotest_common.sh@636 -- # local arg=rpc_cmd 00:22:18.613 18:10:27 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:22:18.613 18:10:27 -- common/autotest_common.sh@640 -- # type -t rpc_cmd 00:22:18.613 18:10:27 -- common/autotest_common.sh@640 -- # case "$(type -t "$arg")" in 00:22:18.613 18:10:27 -- common/autotest_common.sh@651 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t rdma -f ipv4 -a 192.168.100.8 -s 4420 -q nqn.2024-02.io.spdk:host0 -n nqn.2024-02.io.spdk:cnode0 --dhchap-key key2 00:22:18.613 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.613 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.613 request: 00:22:18.613 { 00:22:18.613 "name": "nvme0", 00:22:18.613 "trtype": "rdma", 00:22:18.613 "traddr": "192.168.100.8", 00:22:18.613 "hostnqn": "nqn.2024-02.io.spdk:host0", 00:22:18.613 "adrfam": "ipv4", 00:22:18.613 "trsvcid": "4420", 00:22:18.613 "subnqn": "nqn.2024-02.io.spdk:cnode0", 00:22:18.613 "dhchap_key": "key2", 00:22:18.613 "method": "bdev_nvme_attach_controller", 00:22:18.613 "req_id": 1 00:22:18.613 } 00:22:18.613 Got JSON-RPC error response 00:22:18.613 response: 00:22:18.613 { 00:22:18.613 "code": -32602, 00:22:18.613 "message": "Invalid parameters" 00:22:18.613 } 00:22:18.613 18:10:27 -- common/autotest_common.sh@587 -- # [[ 1 == 0 ]] 00:22:18.613 18:10:27 -- common/autotest_common.sh@651 -- # es=1 00:22:18.613 18:10:27 -- common/autotest_common.sh@659 -- # (( es > 128 )) 00:22:18.613 18:10:27 -- common/autotest_common.sh@670 -- # [[ -n '' ]] 00:22:18.613 18:10:27 -- common/autotest_common.sh@675 -- # (( !es == 0 )) 00:22:18.613 18:10:27 -- host/auth.sh@127 -- # rpc_cmd bdev_nvme_get_controllers 00:22:18.613 18:10:27 -- host/auth.sh@127 -- # jq length 00:22:18.613 18:10:27 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:18.613 18:10:27 -- common/autotest_common.sh@10 -- # set +x 00:22:18.872 18:10:27 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:18.872 18:10:27 -- host/auth.sh@127 -- # (( 0 == 0 )) 00:22:18.872 18:10:27 -- host/auth.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:22:18.872 18:10:27 -- host/auth.sh@130 -- # cleanup 00:22:18.872 18:10:27 -- host/auth.sh@24 -- # nvmftestfini 00:22:18.872 18:10:27 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:18.872 18:10:27 -- nvmf/common.sh@117 -- # sync 00:22:18.872 18:10:27 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:18.872 18:10:27 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:18.872 18:10:27 -- nvmf/common.sh@120 -- # set +e 00:22:18.872 18:10:27 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:18.872 18:10:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:18.872 rmmod nvme_rdma 00:22:18.872 rmmod nvme_fabrics 00:22:18.872 18:10:27 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:18.872 18:10:27 -- nvmf/common.sh@124 -- # set -e 00:22:18.872 18:10:27 -- nvmf/common.sh@125 -- # return 0 00:22:18.872 18:10:27 -- nvmf/common.sh@478 -- # '[' -n 1044497 ']' 00:22:18.872 18:10:27 -- nvmf/common.sh@479 -- # killprocess 1044497 00:22:18.872 18:10:27 -- common/autotest_common.sh@946 -- # '[' -z 1044497 ']' 00:22:18.872 18:10:27 -- common/autotest_common.sh@950 -- # kill -0 1044497 00:22:18.872 18:10:27 -- common/autotest_common.sh@951 -- # uname 00:22:18.872 18:10:27 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:22:18.872 18:10:27 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1044497 00:22:18.872 18:10:27 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:22:18.872 18:10:27 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:22:18.872 18:10:27 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1044497' 00:22:18.872 killing process with pid 1044497 00:22:18.872 18:10:27 -- common/autotest_common.sh@965 -- # kill 1044497 00:22:18.872 18:10:27 -- common/autotest_common.sh@970 -- # wait 1044497 00:22:19.131 18:10:28 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:19.131 18:10:28 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:19.131 18:10:28 -- host/auth.sh@25 -- # rm /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/allowed_hosts/nqn.2024-02.io.spdk:host0 00:22:19.131 18:10:28 -- host/auth.sh@26 -- # rmdir /sys/kernel/config/nvmet/hosts/nqn.2024-02.io.spdk:host0 00:22:19.131 18:10:28 -- host/auth.sh@27 -- # clean_kernel_target 00:22:19.131 18:10:28 -- nvmf/common.sh@673 -- # [[ -e /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 ]] 00:22:19.131 18:10:28 -- nvmf/common.sh@675 -- # echo 0 00:22:19.131 18:10:28 -- nvmf/common.sh@677 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/nqn.2024-02.io.spdk:cnode0 00:22:19.131 18:10:28 -- nvmf/common.sh@678 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0/namespaces/1 00:22:19.131 18:10:28 -- nvmf/common.sh@679 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:22:19.131 18:10:28 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/nqn.2024-02.io.spdk:cnode0 00:22:19.131 18:10:28 -- nvmf/common.sh@682 -- # modules=(/sys/module/nvmet/holders/*) 00:22:19.131 18:10:28 -- nvmf/common.sh@684 -- # modprobe -r nvmet_rdma nvmet 00:22:19.131 18:10:28 -- nvmf/common.sh@687 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:22:22.414 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:22:22.414 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:22:25.702 0000:5f:00.0 (8086 0a54): nvme -> vfio-pci 00:22:25.702 18:10:34 -- host/auth.sh@28 -- # rm -f /tmp/spdk.key-null.m2n /tmp/spdk.key-null.dgX /tmp/spdk.key-sha256.9kA /tmp/spdk.key-sha384.Yqb /tmp/spdk.key-sha512.36b /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/nvme-auth.log 00:22:25.702 18:10:34 -- host/auth.sh@31 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/setup.sh 00:22:29.064 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:5f:00.0 (8086 0a54): Already using the vfio-pci driver 00:22:29.064 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:22:29.064 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:22:29.064 00:22:29.064 real 0m54.245s 00:22:29.064 user 0m41.521s 00:22:29.064 sys 0m15.032s 00:22:29.064 18:10:38 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:22:29.064 18:10:38 -- common/autotest_common.sh@10 -- # set +x 00:22:29.064 ************************************ 00:22:29.064 END TEST nvmf_auth 00:22:29.064 ************************************ 00:22:29.064 18:10:38 -- nvmf/nvmf.sh@104 -- # [[ rdma == \t\c\p ]] 00:22:29.064 18:10:38 -- nvmf/nvmf.sh@108 -- # [[ 0 -eq 1 ]] 00:22:29.064 18:10:38 -- nvmf/nvmf.sh@113 -- # [[ 0 -eq 1 ]] 00:22:29.064 18:10:38 -- nvmf/nvmf.sh@118 -- # [[ phy == phy ]] 00:22:29.064 18:10:38 -- nvmf/nvmf.sh@119 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:22:29.064 18:10:38 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:22:29.064 18:10:38 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:22:29.064 18:10:38 -- common/autotest_common.sh@10 -- # set +x 00:22:29.322 ************************************ 00:22:29.322 START TEST nvmf_bdevperf 00:22:29.322 ************************************ 00:22:29.322 18:10:38 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=rdma 00:22:29.322 * Looking for test storage... 00:22:29.322 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:29.322 18:10:38 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:29.322 18:10:38 -- nvmf/common.sh@7 -- # uname -s 00:22:29.322 18:10:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:29.322 18:10:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:29.322 18:10:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:29.322 18:10:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:29.322 18:10:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:29.322 18:10:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:29.322 18:10:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:29.322 18:10:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:29.322 18:10:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:29.322 18:10:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:29.322 18:10:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:29.322 18:10:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:29.322 18:10:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:29.322 18:10:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:29.322 18:10:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:29.322 18:10:38 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:29.322 18:10:38 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:29.322 18:10:38 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:29.322 18:10:38 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:29.322 18:10:38 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:29.322 18:10:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.322 18:10:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.322 18:10:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.322 18:10:38 -- paths/export.sh@5 -- # export PATH 00:22:29.322 18:10:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:29.322 18:10:38 -- nvmf/common.sh@47 -- # : 0 00:22:29.322 18:10:38 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:29.322 18:10:38 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:29.322 18:10:38 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:29.323 18:10:38 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:29.323 18:10:38 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:29.323 18:10:38 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:29.323 18:10:38 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:29.323 18:10:38 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:29.323 18:10:38 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:29.323 18:10:38 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:29.323 18:10:38 -- host/bdevperf.sh@24 -- # nvmftestinit 00:22:29.323 18:10:38 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:29.323 18:10:38 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:29.323 18:10:38 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:29.323 18:10:38 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:29.323 18:10:38 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:29.323 18:10:38 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.323 18:10:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.323 18:10:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:29.323 18:10:38 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:29.323 18:10:38 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:29.323 18:10:38 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:29.323 18:10:38 -- common/autotest_common.sh@10 -- # set +x 00:22:35.885 18:10:44 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:35.885 18:10:44 -- nvmf/common.sh@291 -- # pci_devs=() 00:22:35.885 18:10:44 -- nvmf/common.sh@291 -- # local -a pci_devs 00:22:35.885 18:10:44 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:22:35.885 18:10:44 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:22:35.885 18:10:44 -- nvmf/common.sh@293 -- # pci_drivers=() 00:22:35.885 18:10:44 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:22:35.885 18:10:44 -- nvmf/common.sh@295 -- # net_devs=() 00:22:35.885 18:10:44 -- nvmf/common.sh@295 -- # local -ga net_devs 00:22:35.885 18:10:44 -- nvmf/common.sh@296 -- # e810=() 00:22:35.885 18:10:44 -- nvmf/common.sh@296 -- # local -ga e810 00:22:35.885 18:10:44 -- nvmf/common.sh@297 -- # x722=() 00:22:35.885 18:10:44 -- nvmf/common.sh@297 -- # local -ga x722 00:22:35.885 18:10:44 -- nvmf/common.sh@298 -- # mlx=() 00:22:35.885 18:10:44 -- nvmf/common.sh@298 -- # local -ga mlx 00:22:35.885 18:10:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:35.886 18:10:44 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:22:35.886 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:22:35.886 18:10:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:35.886 18:10:44 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:22:35.886 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:22:35.886 18:10:44 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:22:35.886 18:10:44 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.886 18:10:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.886 18:10:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:22:35.886 Found net devices under 0000:18:00.0: mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.886 18:10:44 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.886 18:10:44 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:22:35.886 Found net devices under 0000:18:00.1: mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.886 18:10:44 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@403 -- # is_hw=yes 00:22:35.886 18:10:44 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@409 -- # rdma_device_init 00:22:35.886 18:10:44 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:22:35.886 18:10:44 -- nvmf/common.sh@58 -- # uname 00:22:35.886 18:10:44 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:22:35.886 18:10:44 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:22:35.886 18:10:44 -- nvmf/common.sh@63 -- # modprobe ib_core 00:22:35.886 18:10:44 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:22:35.886 18:10:44 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:22:35.886 18:10:44 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:22:35.886 18:10:44 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:22:35.886 18:10:44 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:22:35.886 18:10:44 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:22:35.886 18:10:44 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:22:35.886 18:10:44 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:22:35.886 18:10:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:35.886 18:10:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:35.886 18:10:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:35.886 18:10:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:35.886 18:10:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@105 -- # continue 2 00:22:35.886 18:10:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@105 -- # continue 2 00:22:35.886 18:10:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:35.886 18:10:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:35.886 18:10:44 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:22:35.886 18:10:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:22:35.886 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:35.886 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:22:35.886 altname enp24s0f0np0 00:22:35.886 altname ens785f0np0 00:22:35.886 inet 192.168.100.8/24 scope global mlx_0_0 00:22:35.886 valid_lft forever preferred_lft forever 00:22:35.886 18:10:44 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:22:35.886 18:10:44 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:35.886 18:10:44 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:22:35.886 18:10:44 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:22:35.886 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:22:35.886 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:22:35.886 altname enp24s0f1np1 00:22:35.886 altname ens785f1np1 00:22:35.886 inet 192.168.100.9/24 scope global mlx_0_1 00:22:35.886 valid_lft forever preferred_lft forever 00:22:35.886 18:10:44 -- nvmf/common.sh@411 -- # return 0 00:22:35.886 18:10:44 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:22:35.886 18:10:44 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:22:35.886 18:10:44 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:22:35.886 18:10:44 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:22:35.886 18:10:44 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:22:35.886 18:10:44 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:22:35.886 18:10:44 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:22:35.886 18:10:44 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:22:35.886 18:10:44 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:22:35.886 18:10:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@105 -- # continue 2 00:22:35.886 18:10:44 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:22:35.886 18:10:44 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:22:35.886 18:10:44 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@105 -- # continue 2 00:22:35.886 18:10:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:35.886 18:10:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:35.886 18:10:44 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:22:35.886 18:10:44 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:22:35.886 18:10:44 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:22:35.886 18:10:44 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:22:35.886 192.168.100.9' 00:22:35.886 18:10:44 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:22:35.886 192.168.100.9' 00:22:35.886 18:10:44 -- nvmf/common.sh@446 -- # head -n 1 00:22:35.886 18:10:44 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:22:35.886 18:10:44 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:22:35.886 192.168.100.9' 00:22:35.886 18:10:44 -- nvmf/common.sh@447 -- # tail -n +2 00:22:35.887 18:10:44 -- nvmf/common.sh@447 -- # head -n 1 00:22:35.887 18:10:44 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:22:35.887 18:10:44 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:22:35.887 18:10:44 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:22:35.887 18:10:44 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:22:35.887 18:10:44 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:22:35.887 18:10:44 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:22:35.887 18:10:44 -- host/bdevperf.sh@25 -- # tgt_init 00:22:35.887 18:10:44 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:22:35.887 18:10:44 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:35.887 18:10:44 -- common/autotest_common.sh@720 -- # xtrace_disable 00:22:35.887 18:10:44 -- common/autotest_common.sh@10 -- # set +x 00:22:35.887 18:10:44 -- nvmf/common.sh@470 -- # nvmfpid=1055962 00:22:35.887 18:10:44 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:35.887 18:10:44 -- nvmf/common.sh@471 -- # waitforlisten 1055962 00:22:35.887 18:10:44 -- common/autotest_common.sh@827 -- # '[' -z 1055962 ']' 00:22:35.887 18:10:44 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:35.887 18:10:44 -- common/autotest_common.sh@832 -- # local max_retries=100 00:22:35.887 18:10:44 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:35.887 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:35.887 18:10:44 -- common/autotest_common.sh@836 -- # xtrace_disable 00:22:35.887 18:10:44 -- common/autotest_common.sh@10 -- # set +x 00:22:35.887 [2024-04-26 18:10:44.828892] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:22:35.887 [2024-04-26 18:10:44.828951] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:35.887 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.887 [2024-04-26 18:10:44.902373] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:35.887 [2024-04-26 18:10:44.985881] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:35.887 [2024-04-26 18:10:44.985928] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:35.887 [2024-04-26 18:10:44.985938] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:35.887 [2024-04-26 18:10:44.985962] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:35.887 [2024-04-26 18:10:44.985970] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:35.887 [2024-04-26 18:10:44.986075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:35.887 [2024-04-26 18:10:44.986154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:35.887 [2024-04-26 18:10:44.986156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.453 18:10:45 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:22:36.453 18:10:45 -- common/autotest_common.sh@860 -- # return 0 00:22:36.453 18:10:45 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:36.453 18:10:45 -- common/autotest_common.sh@726 -- # xtrace_disable 00:22:36.453 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.711 18:10:45 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:36.711 18:10:45 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:36.711 18:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:36.711 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.711 [2024-04-26 18:10:45.712003] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1b62d30/0x1b67220) succeed. 00:22:36.711 [2024-04-26 18:10:45.722089] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1b642d0/0x1ba88b0) succeed. 00:22:36.711 18:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:36.711 18:10:45 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:36.711 18:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:36.711 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.711 Malloc0 00:22:36.711 18:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:36.711 18:10:45 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:36.711 18:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:36.711 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.711 18:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:36.711 18:10:45 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:36.711 18:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:36.711 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.711 18:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:36.711 18:10:45 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:36.711 18:10:45 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:36.711 18:10:45 -- common/autotest_common.sh@10 -- # set +x 00:22:36.712 [2024-04-26 18:10:45.880634] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:36.712 18:10:45 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:36.712 18:10:45 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:22:36.712 18:10:45 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:22:36.712 18:10:45 -- nvmf/common.sh@521 -- # config=() 00:22:36.712 18:10:45 -- nvmf/common.sh@521 -- # local subsystem config 00:22:36.712 18:10:45 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:36.712 18:10:45 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:36.712 { 00:22:36.712 "params": { 00:22:36.712 "name": "Nvme$subsystem", 00:22:36.712 "trtype": "$TEST_TRANSPORT", 00:22:36.712 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.712 "adrfam": "ipv4", 00:22:36.712 "trsvcid": "$NVMF_PORT", 00:22:36.712 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.712 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.712 "hdgst": ${hdgst:-false}, 00:22:36.712 "ddgst": ${ddgst:-false} 00:22:36.712 }, 00:22:36.712 "method": "bdev_nvme_attach_controller" 00:22:36.712 } 00:22:36.712 EOF 00:22:36.712 )") 00:22:36.712 18:10:45 -- nvmf/common.sh@543 -- # cat 00:22:36.712 18:10:45 -- nvmf/common.sh@545 -- # jq . 00:22:36.712 18:10:45 -- nvmf/common.sh@546 -- # IFS=, 00:22:36.712 18:10:45 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:36.712 "params": { 00:22:36.712 "name": "Nvme1", 00:22:36.712 "trtype": "rdma", 00:22:36.712 "traddr": "192.168.100.8", 00:22:36.712 "adrfam": "ipv4", 00:22:36.712 "trsvcid": "4420", 00:22:36.712 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.712 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:36.712 "hdgst": false, 00:22:36.712 "ddgst": false 00:22:36.712 }, 00:22:36.712 "method": "bdev_nvme_attach_controller" 00:22:36.712 }' 00:22:36.970 [2024-04-26 18:10:45.931770] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:22:36.970 [2024-04-26 18:10:45.931832] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1056042 ] 00:22:36.970 EAL: No free 2048 kB hugepages reported on node 1 00:22:36.970 [2024-04-26 18:10:46.004637] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:36.970 [2024-04-26 18:10:46.085278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:37.229 Running I/O for 1 seconds... 00:22:38.172 00:22:38.172 Latency(us) 00:22:38.172 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:38.172 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:38.172 Verification LBA range: start 0x0 length 0x4000 00:22:38.172 Nvme1n1 : 1.00 18132.57 70.83 0.00 0.00 7014.71 747.97 12195.39 00:22:38.172 =================================================================================================================== 00:22:38.172 Total : 18132.57 70.83 0.00 0.00 7014.71 747.97 12195.39 00:22:38.431 18:10:47 -- host/bdevperf.sh@30 -- # bdevperfpid=1056337 00:22:38.431 18:10:47 -- host/bdevperf.sh@32 -- # sleep 3 00:22:38.431 18:10:47 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:22:38.431 18:10:47 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:22:38.431 18:10:47 -- nvmf/common.sh@521 -- # config=() 00:22:38.431 18:10:47 -- nvmf/common.sh@521 -- # local subsystem config 00:22:38.431 18:10:47 -- nvmf/common.sh@523 -- # for subsystem in "${@:-1}" 00:22:38.431 18:10:47 -- nvmf/common.sh@543 -- # config+=("$(cat <<-EOF 00:22:38.431 { 00:22:38.431 "params": { 00:22:38.431 "name": "Nvme$subsystem", 00:22:38.431 "trtype": "$TEST_TRANSPORT", 00:22:38.431 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:38.431 "adrfam": "ipv4", 00:22:38.431 "trsvcid": "$NVMF_PORT", 00:22:38.431 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:38.431 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:38.431 "hdgst": ${hdgst:-false}, 00:22:38.431 "ddgst": ${ddgst:-false} 00:22:38.431 }, 00:22:38.431 "method": "bdev_nvme_attach_controller" 00:22:38.431 } 00:22:38.431 EOF 00:22:38.431 )") 00:22:38.431 18:10:47 -- nvmf/common.sh@543 -- # cat 00:22:38.431 18:10:47 -- nvmf/common.sh@545 -- # jq . 00:22:38.431 18:10:47 -- nvmf/common.sh@546 -- # IFS=, 00:22:38.431 18:10:47 -- nvmf/common.sh@547 -- # printf '%s\n' '{ 00:22:38.431 "params": { 00:22:38.431 "name": "Nvme1", 00:22:38.431 "trtype": "rdma", 00:22:38.431 "traddr": "192.168.100.8", 00:22:38.431 "adrfam": "ipv4", 00:22:38.431 "trsvcid": "4420", 00:22:38.431 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:38.431 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:38.431 "hdgst": false, 00:22:38.431 "ddgst": false 00:22:38.431 }, 00:22:38.431 "method": "bdev_nvme_attach_controller" 00:22:38.431 }' 00:22:38.431 [2024-04-26 18:10:47.578806] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:22:38.431 [2024-04-26 18:10:47.578871] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1056337 ] 00:22:38.431 EAL: No free 2048 kB hugepages reported on node 1 00:22:38.690 [2024-04-26 18:10:47.652270] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:38.690 [2024-04-26 18:10:47.732082] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:38.949 Running I/O for 15 seconds... 00:22:41.485 18:10:50 -- host/bdevperf.sh@33 -- # kill -9 1055962 00:22:41.485 18:10:50 -- host/bdevperf.sh@35 -- # sleep 3 00:22:42.425 [2024-04-26 18:10:51.576269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:122656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:122664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:122672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:122680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:122688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:122696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:122704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:122712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:122720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:122728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:122736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:122744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:122752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:122760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:122768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:122776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:122784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:122792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:122800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:122808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:122816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.425 [2024-04-26 18:10:51.576749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:122824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.425 [2024-04-26 18:10:51.576758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:122832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:122840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:122848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:122856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:122864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:122872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:22:42.426 [2024-04-26 18:10:51.576877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:121856 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fe000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.576898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:121864 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fc000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.576918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:121872 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075fa000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.576940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:121880 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f8000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.576960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:121888 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f6000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.576980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.576991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:121896 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f4000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:121904 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f2000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:121912 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075f0000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:121920 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ee000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:121928 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ec000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:121936 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ea000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:121944 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e8000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:121952 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e6000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:121960 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e4000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:121968 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e2000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:121976 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075e0000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:121984 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075de000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:121992 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075dc000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:122000 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075da000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:122008 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d8000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:122016 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d6000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122024 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d4000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:122032 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d2000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:122040 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075d0000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:122048 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ce000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:122056 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075cc000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:122064 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ca000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:122072 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c8000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:122080 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c6000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:122088 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c4000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:122096 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c2000 len:0x1000 key:0x181500 00:22:42.426 [2024-04-26 18:10:51.577514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.426 [2024-04-26 18:10:51.577525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:122104 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075c0000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122112 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075be000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:122120 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075bc000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:122128 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ba000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:122136 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b8000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:122144 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b6000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:122152 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b4000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:122160 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b2000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:122168 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075b0000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:122176 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ae000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:122184 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075ac000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:122192 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075aa000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:122200 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a8000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:122208 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a6000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:122216 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a4000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:122224 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a2000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122232 len:8 SGL KEYED DATA BLOCK ADDRESS 0x2000075a0000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:122240 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759e000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:122248 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759c000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:122256 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000759a000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:122264 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007598000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:122272 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007596000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.577981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:122280 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007594000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.577991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:122288 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007592000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:122296 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007590000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:122304 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758e000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:122312 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758c000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:122320 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000758a000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:122328 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007588000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:122336 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007586000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:122344 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007584000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:122352 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007582000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:122360 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007580000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122368 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757e000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122376 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757c000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122384 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000757a000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:122392 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007578000 len:0x1000 key:0x181500 00:22:42.427 [2024-04-26 18:10:51.578280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.427 [2024-04-26 18:10:51.578290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:122400 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007576000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:122408 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007574000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:122416 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007572000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:122424 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007570000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:122432 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756e000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:122440 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756c000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:122448 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000756a000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:122456 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007568000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:122464 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007566000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:122472 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007564000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:122480 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007562000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:122488 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007560000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122496 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755e000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:122504 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755c000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:122512 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000755a000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:122520 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007558000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122528 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007556000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:122536 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007554000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:122544 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007552000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122552 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007550000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:122560 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754e000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:122568 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754c000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:122576 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000754a000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:122584 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007548000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:122592 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007546000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:122600 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007544000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:122608 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007542000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.578907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:122616 len:8 SGL KEYED DATA BLOCK ADDRESS 0x200007540000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.578917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.587978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:122624 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753e000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.587995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.588010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:122632 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753c000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.588022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.588037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:122640 len:8 SGL KEYED DATA BLOCK ADDRESS 0x20000753a000 len:0x1000 key:0x181500 00:22:42.428 [2024-04-26 18:10:51.588050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:8192 cdw0:0 sqhd:f200 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.589954] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:22:42.428 [2024-04-26 18:10:51.589970] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:22:42.428 [2024-04-26 18:10:51.589982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122648 len:8 PRP1 0x0 PRP2 0x0 00:22:42.428 [2024-04-26 18:10:51.589994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.590044] bdev_nvme.c:1601:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2000192e4a00 was disconnected and freed. reset controller. 00:22:42.428 [2024-04-26 18:10:51.590081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.428 [2024-04-26 18:10:51.590095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.590109] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.428 [2024-04-26 18:10:51.590121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.590135] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.428 [2024-04-26 18:10:51.590147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.590160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:22:42.428 [2024-04-26 18:10:51.590173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:42.428 [2024-04-26 18:10:51.609406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:42.428 [2024-04-26 18:10:51.609468] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:42.429 [2024-04-26 18:10:51.609502] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:42.429 [2024-04-26 18:10:51.612421] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:42.429 [2024-04-26 18:10:51.614831] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:42.429 [2024-04-26 18:10:51.614851] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:42.429 [2024-04-26 18:10:51.614860] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:43.806 [2024-04-26 18:10:52.618845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:43.806 [2024-04-26 18:10:52.618867] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:43.806 [2024-04-26 18:10:52.619059] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:43.806 [2024-04-26 18:10:52.619070] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:43.806 [2024-04-26 18:10:52.619081] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:43.806 [2024-04-26 18:10:52.620852] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:43.806 [2024-04-26 18:10:52.621791] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:43.806 [2024-04-26 18:10:52.633692] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:43.806 [2024-04-26 18:10:52.636539] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:43.806 [2024-04-26 18:10:52.636559] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:43.806 [2024-04-26 18:10:52.636567] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:44.373 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 1055962 Killed "${NVMF_APP[@]}" "$@" 00:22:44.373 18:10:53 -- host/bdevperf.sh@36 -- # tgt_init 00:22:44.373 18:10:53 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:22:44.373 18:10:53 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:22:44.373 18:10:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:22:44.373 18:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:44.373 18:10:53 -- nvmf/common.sh@470 -- # nvmfpid=1057089 00:22:44.373 18:10:53 -- nvmf/common.sh@471 -- # waitforlisten 1057089 00:22:44.373 18:10:53 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:22:44.373 18:10:53 -- common/autotest_common.sh@827 -- # '[' -z 1057089 ']' 00:22:44.373 18:10:53 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:44.373 18:10:53 -- common/autotest_common.sh@832 -- # local max_retries=100 00:22:44.373 18:10:53 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:44.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:44.373 18:10:53 -- common/autotest_common.sh@836 -- # xtrace_disable 00:22:44.373 18:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:44.632 [2024-04-26 18:10:53.602624] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:22:44.632 [2024-04-26 18:10:53.602686] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:44.632 EAL: No free 2048 kB hugepages reported on node 1 00:22:44.632 [2024-04-26 18:10:53.640561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:44.632 [2024-04-26 18:10:53.640598] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:44.632 [2024-04-26 18:10:53.640776] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:44.632 [2024-04-26 18:10:53.640787] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:44.632 [2024-04-26 18:10:53.640798] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:44.632 [2024-04-26 18:10:53.642594] bdev_nvme.c:2878:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:44.632 [2024-04-26 18:10:53.643565] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:44.632 [2024-04-26 18:10:53.655603] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:44.632 [2024-04-26 18:10:53.658099] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:22:44.632 [2024-04-26 18:10:53.658120] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:22:44.632 [2024-04-26 18:10:53.658128] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000192ed080 00:22:44.632 [2024-04-26 18:10:53.677108] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 3 00:22:44.632 [2024-04-26 18:10:53.762316] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:44.632 [2024-04-26 18:10:53.762360] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:44.632 [2024-04-26 18:10:53.762371] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:22:44.632 [2024-04-26 18:10:53.762396] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:22:44.632 [2024-04-26 18:10:53.762403] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:44.632 [2024-04-26 18:10:53.762451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:44.632 [2024-04-26 18:10:53.762531] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:44.632 [2024-04-26 18:10:53.762533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:45.569 18:10:54 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:22:45.569 18:10:54 -- common/autotest_common.sh@860 -- # return 0 00:22:45.569 18:10:54 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:22:45.569 18:10:54 -- common/autotest_common.sh@726 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 18:10:54 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:45.569 18:10:54 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 -u 8192 00:22:45.569 18:10:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 [2024-04-26 18:10:54.506720] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xfcfd30/0xfd4220) succeed. 00:22:45.569 [2024-04-26 18:10:54.516836] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xfd12d0/0x10158b0) succeed. 00:22:45.569 18:10:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:45.569 18:10:54 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:45.569 18:10:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 Malloc0 00:22:45.569 18:10:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:45.569 18:10:54 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:45.569 18:10:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 18:10:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:45.569 18:10:54 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:22:45.569 18:10:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 [2024-04-26 18:10:54.662115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:22:45.569 [2024-04-26 18:10:54.662148] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:45.569 [2024-04-26 18:10:54.662326] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:45.569 [2024-04-26 18:10:54.662341] nvme_ctrlr.c:1749:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:45.569 [2024-04-26 18:10:54.662353] nvme_ctrlr.c:1030:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] already in failed state 00:22:45.569 [2024-04-26 18:10:54.665083] bdev_nvme.c:2052:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:45.569 18:10:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:45.569 18:10:54 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:22:45.569 18:10:54 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:45.569 18:10:54 -- common/autotest_common.sh@10 -- # set +x 00:22:45.569 [2024-04-26 18:10:54.670535] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:22:45.569 [2024-04-26 18:10:54.670573] nvme_ctrlr.c:1651:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:45.569 18:10:54 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:45.569 18:10:54 -- host/bdevperf.sh@38 -- # wait 1056337 00:22:45.569 [2024-04-26 18:10:54.714279] bdev_nvme.c:2054:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:22:55.543 00:22:55.543 Latency(us) 00:22:55.543 Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:55.543 Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:22:55.543 Verification LBA range: start 0x0 length 0x4000 00:22:55.543 Nvme1n1 : 15.01 13152.69 51.38 10415.59 0.00 5411.28 343.71 1072282.94 00:22:55.543 =================================================================================================================== 00:22:55.543 Total : 13152.69 51.38 10415.59 0.00 5411.28 343.71 1072282.94 00:22:55.543 18:11:03 -- host/bdevperf.sh@39 -- # sync 00:22:55.543 18:11:03 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:55.543 18:11:03 -- common/autotest_common.sh@559 -- # xtrace_disable 00:22:55.543 18:11:03 -- common/autotest_common.sh@10 -- # set +x 00:22:55.543 18:11:03 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:22:55.543 18:11:03 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:22:55.543 18:11:03 -- host/bdevperf.sh@44 -- # nvmftestfini 00:22:55.543 18:11:03 -- nvmf/common.sh@477 -- # nvmfcleanup 00:22:55.543 18:11:03 -- nvmf/common.sh@117 -- # sync 00:22:55.543 18:11:03 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:22:55.543 18:11:03 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:22:55.543 18:11:03 -- nvmf/common.sh@120 -- # set +e 00:22:55.543 18:11:03 -- nvmf/common.sh@121 -- # for i in {1..20} 00:22:55.543 18:11:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:22:55.543 rmmod nvme_rdma 00:22:55.543 rmmod nvme_fabrics 00:22:55.543 18:11:03 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:22:55.543 18:11:03 -- nvmf/common.sh@124 -- # set -e 00:22:55.543 18:11:03 -- nvmf/common.sh@125 -- # return 0 00:22:55.543 18:11:03 -- nvmf/common.sh@478 -- # '[' -n 1057089 ']' 00:22:55.543 18:11:03 -- nvmf/common.sh@479 -- # killprocess 1057089 00:22:55.543 18:11:03 -- common/autotest_common.sh@946 -- # '[' -z 1057089 ']' 00:22:55.543 18:11:03 -- common/autotest_common.sh@950 -- # kill -0 1057089 00:22:55.543 18:11:03 -- common/autotest_common.sh@951 -- # uname 00:22:55.543 18:11:03 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:22:55.543 18:11:03 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1057089 00:22:55.543 18:11:03 -- common/autotest_common.sh@952 -- # process_name=reactor_1 00:22:55.543 18:11:03 -- common/autotest_common.sh@956 -- # '[' reactor_1 = sudo ']' 00:22:55.543 18:11:03 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1057089' 00:22:55.543 killing process with pid 1057089 00:22:55.543 18:11:03 -- common/autotest_common.sh@965 -- # kill 1057089 00:22:55.543 18:11:03 -- common/autotest_common.sh@970 -- # wait 1057089 00:22:55.543 [2024-04-26 18:11:03.405985] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:22:55.543 18:11:03 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:22:55.543 18:11:03 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:22:55.543 00:22:55.543 real 0m25.368s 00:22:55.543 user 1m5.029s 00:22:55.543 sys 0m6.139s 00:22:55.543 18:11:03 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:22:55.543 18:11:03 -- common/autotest_common.sh@10 -- # set +x 00:22:55.543 ************************************ 00:22:55.543 END TEST nvmf_bdevperf 00:22:55.543 ************************************ 00:22:55.543 18:11:03 -- nvmf/nvmf.sh@120 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:22:55.543 18:11:03 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:22:55.543 18:11:03 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:22:55.543 18:11:03 -- common/autotest_common.sh@10 -- # set +x 00:22:55.543 ************************************ 00:22:55.543 START TEST nvmf_target_disconnect 00:22:55.543 ************************************ 00:22:55.543 18:11:03 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=rdma 00:22:55.543 * Looking for test storage... 00:22:55.543 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host 00:22:55.543 18:11:03 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.543 18:11:03 -- nvmf/common.sh@7 -- # uname -s 00:22:55.543 18:11:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.543 18:11:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.543 18:11:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.543 18:11:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.543 18:11:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.543 18:11:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.543 18:11:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.543 18:11:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.543 18:11:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.543 18:11:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.543 18:11:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:22:55.543 18:11:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:22:55.543 18:11:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.543 18:11:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.543 18:11:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.543 18:11:03 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:22:55.543 18:11:03 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:22:55.543 18:11:03 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.543 18:11:03 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.543 18:11:03 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.543 18:11:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.543 18:11:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.544 18:11:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.544 18:11:03 -- paths/export.sh@5 -- # export PATH 00:22:55.544 18:11:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.544 18:11:03 -- nvmf/common.sh@47 -- # : 0 00:22:55.544 18:11:03 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:22:55.544 18:11:03 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:22:55.544 18:11:03 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:22:55.544 18:11:03 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.544 18:11:03 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.544 18:11:03 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:22:55.544 18:11:03 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:22:55.544 18:11:03 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:22:55.544 18:11:03 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-phy-autotest/spdk/app/fio/nvme 00:22:55.544 18:11:03 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:22:55.544 18:11:03 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:22:55.544 18:11:03 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:22:55.544 18:11:03 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:22:55.544 18:11:03 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.544 18:11:03 -- nvmf/common.sh@437 -- # prepare_net_devs 00:22:55.544 18:11:03 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:22:55.544 18:11:03 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:22:55.544 18:11:03 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.544 18:11:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.544 18:11:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.544 18:11:03 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:22:55.544 18:11:03 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:22:55.544 18:11:03 -- nvmf/common.sh@285 -- # xtrace_disable 00:22:55.544 18:11:03 -- common/autotest_common.sh@10 -- # set +x 00:23:00.815 18:11:09 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:00.815 18:11:09 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:00.815 18:11:09 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:00.815 18:11:09 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:00.815 18:11:09 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:00.815 18:11:09 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:00.815 18:11:09 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:00.815 18:11:09 -- nvmf/common.sh@295 -- # net_devs=() 00:23:00.815 18:11:09 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:00.815 18:11:09 -- nvmf/common.sh@296 -- # e810=() 00:23:00.815 18:11:09 -- nvmf/common.sh@296 -- # local -ga e810 00:23:00.815 18:11:09 -- nvmf/common.sh@297 -- # x722=() 00:23:00.815 18:11:09 -- nvmf/common.sh@297 -- # local -ga x722 00:23:00.815 18:11:09 -- nvmf/common.sh@298 -- # mlx=() 00:23:00.815 18:11:09 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:00.815 18:11:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:00.815 18:11:09 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:00.815 18:11:09 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:00.815 18:11:09 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:00.815 18:11:10 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:00.815 18:11:10 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:00.815 18:11:10 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:00.815 18:11:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:00.815 18:11:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:23:00.815 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:23:00.815 18:11:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:00.815 18:11:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:00.816 18:11:10 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:00.816 18:11:10 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:23:00.816 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:23:00.816 18:11:10 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:00.816 18:11:10 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:00.816 18:11:10 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:00.816 18:11:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.816 18:11:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:00.816 18:11:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.816 18:11:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:23:00.816 Found net devices under 0000:18:00.0: mlx_0_0 00:23:00.816 18:11:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.816 18:11:10 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:00.816 18:11:10 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:00.816 18:11:10 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:00.816 18:11:10 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:00.816 18:11:10 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:23:00.816 Found net devices under 0000:18:00.1: mlx_0_1 00:23:00.816 18:11:10 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:00.816 18:11:10 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:00.816 18:11:10 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:00.816 18:11:10 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:00.816 18:11:10 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:00.816 18:11:10 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:01.074 18:11:10 -- nvmf/common.sh@58 -- # uname 00:23:01.074 18:11:10 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:01.074 18:11:10 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:01.074 18:11:10 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:01.074 18:11:10 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:01.074 18:11:10 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:01.074 18:11:10 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:01.074 18:11:10 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:01.074 18:11:10 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:01.074 18:11:10 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:01.074 18:11:10 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:01.074 18:11:10 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:01.074 18:11:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:01.074 18:11:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:01.074 18:11:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:01.074 18:11:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:01.074 18:11:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:01.074 18:11:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@105 -- # continue 2 00:23:01.074 18:11:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@105 -- # continue 2 00:23:01.074 18:11:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:01.074 18:11:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:01.074 18:11:10 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:01.074 18:11:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:01.074 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:01.074 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:23:01.074 altname enp24s0f0np0 00:23:01.074 altname ens785f0np0 00:23:01.074 inet 192.168.100.8/24 scope global mlx_0_0 00:23:01.074 valid_lft forever preferred_lft forever 00:23:01.074 18:11:10 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:01.074 18:11:10 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:01.074 18:11:10 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:01.074 18:11:10 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:01.074 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:01.074 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:23:01.074 altname enp24s0f1np1 00:23:01.074 altname ens785f1np1 00:23:01.074 inet 192.168.100.9/24 scope global mlx_0_1 00:23:01.074 valid_lft forever preferred_lft forever 00:23:01.074 18:11:10 -- nvmf/common.sh@411 -- # return 0 00:23:01.074 18:11:10 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:01.074 18:11:10 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:01.074 18:11:10 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:01.074 18:11:10 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:01.074 18:11:10 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:01.074 18:11:10 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:01.074 18:11:10 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:01.074 18:11:10 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:01.074 18:11:10 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:01.074 18:11:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@105 -- # continue 2 00:23:01.074 18:11:10 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:01.074 18:11:10 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:01.074 18:11:10 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@105 -- # continue 2 00:23:01.074 18:11:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:01.074 18:11:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:01.074 18:11:10 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:01.074 18:11:10 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:01.074 18:11:10 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:01.074 18:11:10 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:01.074 192.168.100.9' 00:23:01.074 18:11:10 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:01.074 192.168.100.9' 00:23:01.074 18:11:10 -- nvmf/common.sh@446 -- # head -n 1 00:23:01.074 18:11:10 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:01.074 18:11:10 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:01.074 192.168.100.9' 00:23:01.074 18:11:10 -- nvmf/common.sh@447 -- # tail -n +2 00:23:01.074 18:11:10 -- nvmf/common.sh@447 -- # head -n 1 00:23:01.074 18:11:10 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:01.074 18:11:10 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:01.074 18:11:10 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:01.074 18:11:10 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:01.074 18:11:10 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:01.074 18:11:10 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:01.074 18:11:10 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:23:01.074 18:11:10 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:23:01.074 18:11:10 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:01.074 18:11:10 -- common/autotest_common.sh@10 -- # set +x 00:23:01.397 ************************************ 00:23:01.397 START TEST nvmf_target_disconnect_tc1 00:23:01.397 ************************************ 00:23:01.397 18:11:10 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc1 00:23:01.397 18:11:10 -- host/target_disconnect.sh@32 -- # set +e 00:23:01.397 18:11:10 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:23:01.397 EAL: No free 2048 kB hugepages reported on node 1 00:23:01.397 [2024-04-26 18:11:10.528962] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_ESTABLISHED but received RDMA_CM_EVENT_REJECTED (8) from CM event channel (status = 8) 00:23:01.397 [2024-04-26 18:11:10.529021] nvme_rdma.c:1167:nvme_rdma_connect_established: *ERROR*: RDMA connect error -74 00:23:01.397 [2024-04-26 18:11:10.529031] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d7080 00:23:02.774 [2024-04-26 18:11:11.533074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:02.774 [2024-04-26 18:11:11.533144] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:23:02.774 [2024-04-26 18:11:11.533180] nvme_ctrlr.c:4040:nvme_ctrlr_process_init: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr is in error state 00:23:02.774 [2024-04-26 18:11:11.533248] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:23:02.774 [2024-04-26 18:11:11.533277] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:23:02.774 spdk_nvme_probe() failed for transport address '192.168.100.8' 00:23:02.774 /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:23:02.774 Initializing NVMe Controllers 00:23:02.774 18:11:11 -- host/target_disconnect.sh@33 -- # trap - ERR 00:23:02.774 18:11:11 -- host/target_disconnect.sh@33 -- # print_backtrace 00:23:02.774 18:11:11 -- common/autotest_common.sh@1149 -- # [[ hxBET =~ e ]] 00:23:02.774 18:11:11 -- common/autotest_common.sh@1149 -- # return 0 00:23:02.774 18:11:11 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:23:02.774 18:11:11 -- host/target_disconnect.sh@41 -- # set -e 00:23:02.774 00:23:02.774 real 0m1.131s 00:23:02.774 user 0m0.815s 00:23:02.774 sys 0m0.304s 00:23:02.774 18:11:11 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:02.774 18:11:11 -- common/autotest_common.sh@10 -- # set +x 00:23:02.774 ************************************ 00:23:02.774 END TEST nvmf_target_disconnect_tc1 00:23:02.774 ************************************ 00:23:02.774 18:11:11 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:23:02.774 18:11:11 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:23:02.774 18:11:11 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:02.774 18:11:11 -- common/autotest_common.sh@10 -- # set +x 00:23:02.774 ************************************ 00:23:02.774 START TEST nvmf_target_disconnect_tc2 00:23:02.774 ************************************ 00:23:02.774 18:11:11 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc2 00:23:02.774 18:11:11 -- host/target_disconnect.sh@45 -- # disconnect_init 192.168.100.8 00:23:02.774 18:11:11 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:23:02.774 18:11:11 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:02.774 18:11:11 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:02.774 18:11:11 -- common/autotest_common.sh@10 -- # set +x 00:23:02.774 18:11:11 -- nvmf/common.sh@470 -- # nvmfpid=1061493 00:23:02.774 18:11:11 -- nvmf/common.sh@471 -- # waitforlisten 1061493 00:23:02.774 18:11:11 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:23:02.774 18:11:11 -- common/autotest_common.sh@827 -- # '[' -z 1061493 ']' 00:23:02.774 18:11:11 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:02.774 18:11:11 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:02.774 18:11:11 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:02.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:02.774 18:11:11 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:02.774 18:11:11 -- common/autotest_common.sh@10 -- # set +x 00:23:02.774 [2024-04-26 18:11:11.768726] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:23:02.774 [2024-04-26 18:11:11.768780] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:02.774 EAL: No free 2048 kB hugepages reported on node 1 00:23:02.774 [2024-04-26 18:11:11.853802] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:02.774 [2024-04-26 18:11:11.943227] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:02.774 [2024-04-26 18:11:11.943274] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:02.774 [2024-04-26 18:11:11.943284] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:02.774 [2024-04-26 18:11:11.943308] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:02.774 [2024-04-26 18:11:11.943317] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:02.774 [2024-04-26 18:11:11.943443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:23:02.774 [2024-04-26 18:11:11.943556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:23:02.774 [2024-04-26 18:11:11.943638] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:02.774 [2024-04-26 18:11:11.943637] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:23:03.709 18:11:12 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:03.709 18:11:12 -- common/autotest_common.sh@860 -- # return 0 00:23:03.709 18:11:12 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:03.709 18:11:12 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 18:11:12 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:03.709 18:11:12 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 Malloc0 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 [2024-04-26 18:11:12.692045] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x106d400/0x1079220) succeed. 00:23:03.709 [2024-04-26 18:11:12.702869] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x106ea40/0x10f9280) succeed. 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 [2024-04-26 18:11:12.848249] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:23:03.709 18:11:12 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:03.709 18:11:12 -- common/autotest_common.sh@10 -- # set +x 00:23:03.709 18:11:12 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:03.709 18:11:12 -- host/target_disconnect.sh@50 -- # reconnectpid=1061692 00:23:03.709 18:11:12 -- host/target_disconnect.sh@52 -- # sleep 2 00:23:03.709 18:11:12 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420' 00:23:03.967 EAL: No free 2048 kB hugepages reported on node 1 00:23:05.919 18:11:14 -- host/target_disconnect.sh@53 -- # kill -9 1061493 00:23:05.919 18:11:14 -- host/target_disconnect.sh@55 -- # sleep 2 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Read completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 Write completed with error (sct=0, sc=8) 00:23:07.292 starting I/O failed 00:23:07.292 [2024-04-26 18:11:16.048367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:07.859 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 1061493 Killed "${NVMF_APP[@]}" "$@" 00:23:07.859 18:11:16 -- host/target_disconnect.sh@56 -- # disconnect_init 192.168.100.8 00:23:07.859 18:11:16 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:23:07.859 18:11:16 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:07.859 18:11:16 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:07.859 18:11:16 -- common/autotest_common.sh@10 -- # set +x 00:23:07.859 18:11:16 -- nvmf/common.sh@470 -- # nvmfpid=1062237 00:23:07.859 18:11:16 -- nvmf/common.sh@471 -- # waitforlisten 1062237 00:23:07.859 18:11:16 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:23:07.859 18:11:16 -- common/autotest_common.sh@827 -- # '[' -z 1062237 ']' 00:23:07.859 18:11:16 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:07.859 18:11:16 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:07.859 18:11:16 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:07.859 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:07.859 18:11:16 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:07.859 18:11:16 -- common/autotest_common.sh@10 -- # set +x 00:23:07.859 [2024-04-26 18:11:16.924960] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:23:07.859 [2024-04-26 18:11:16.925014] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:07.859 EAL: No free 2048 kB hugepages reported on node 1 00:23:07.859 [2024-04-26 18:11:17.010729] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:07.859 Write completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Write completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Write completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.859 Read completed with error (sct=0, sc=8) 00:23:07.859 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Read completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:07.860 Write completed with error (sct=0, sc=8) 00:23:07.860 starting I/O failed 00:23:08.118 [2024-04-26 18:11:17.053437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:08.118 [2024-04-26 18:11:17.097835] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:08.118 [2024-04-26 18:11:17.097877] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:08.118 [2024-04-26 18:11:17.097886] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:08.118 [2024-04-26 18:11:17.097895] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:08.118 [2024-04-26 18:11:17.097902] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:08.118 [2024-04-26 18:11:17.098026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:23:08.118 [2024-04-26 18:11:17.098129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:23:08.118 [2024-04-26 18:11:17.098227] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:08.118 [2024-04-26 18:11:17.098229] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:23:08.685 18:11:17 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:08.685 18:11:17 -- common/autotest_common.sh@860 -- # return 0 00:23:08.685 18:11:17 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:08.685 18:11:17 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:08.685 18:11:17 -- common/autotest_common.sh@10 -- # set +x 00:23:08.685 18:11:17 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:08.685 18:11:17 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:08.685 18:11:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.685 18:11:17 -- common/autotest_common.sh@10 -- # set +x 00:23:08.685 Malloc0 00:23:08.685 18:11:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.685 18:11:17 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:23:08.685 18:11:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.685 18:11:17 -- common/autotest_common.sh@10 -- # set +x 00:23:08.685 [2024-04-26 18:11:17.844273] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x1f1d400/0x1f29220) succeed. 00:23:08.685 [2024-04-26 18:11:17.856034] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x1f1ea40/0x1fa9280) succeed. 00:23:08.943 18:11:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.943 18:11:17 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:08.943 18:11:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.943 18:11:17 -- common/autotest_common.sh@10 -- # set +x 00:23:08.943 18:11:17 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.943 18:11:17 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:08.943 18:11:17 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.943 18:11:17 -- common/autotest_common.sh@10 -- # set +x 00:23:08.943 18:11:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.943 18:11:18 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.8 -s 4420 00:23:08.943 18:11:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.943 18:11:18 -- common/autotest_common.sh@10 -- # set +x 00:23:08.943 [2024-04-26 18:11:18.009833] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4420 *** 00:23:08.943 18:11:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.943 18:11:18 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.8 -s 4420 00:23:08.943 18:11:18 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:08.943 18:11:18 -- common/autotest_common.sh@10 -- # set +x 00:23:08.943 18:11:18 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:08.943 18:11:18 -- host/target_disconnect.sh@58 -- # wait 1061692 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Write completed with error (sct=0, sc=8) 00:23:08.943 starting I/O failed 00:23:08.943 Read completed with error (sct=0, sc=8) 00:23:08.944 starting I/O failed 00:23:08.944 [2024-04-26 18:11:18.058798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:08.944 [2024-04-26 18:11:18.063729] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:08.944 [2024-04-26 18:11:18.063786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:08.944 [2024-04-26 18:11:18.063809] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:08.944 [2024-04-26 18:11:18.063821] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:08.944 [2024-04-26 18:11:18.063832] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:08.944 [2024-04-26 18:11:18.073861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:08.944 qpair failed and we were unable to recover it. 00:23:08.944 [2024-04-26 18:11:18.083699] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:08.944 [2024-04-26 18:11:18.083736] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:08.944 [2024-04-26 18:11:18.083754] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:08.944 [2024-04-26 18:11:18.083764] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:08.944 [2024-04-26 18:11:18.083773] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:08.944 [2024-04-26 18:11:18.094189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:08.944 qpair failed and we were unable to recover it. 00:23:08.944 [2024-04-26 18:11:18.103801] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:08.944 [2024-04-26 18:11:18.103841] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:08.944 [2024-04-26 18:11:18.103859] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:08.944 [2024-04-26 18:11:18.103869] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:08.944 [2024-04-26 18:11:18.103881] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:08.944 [2024-04-26 18:11:18.113977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:08.944 qpair failed and we were unable to recover it. 00:23:08.944 [2024-04-26 18:11:18.123812] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:08.944 [2024-04-26 18:11:18.123859] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:08.944 [2024-04-26 18:11:18.123877] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:08.944 [2024-04-26 18:11:18.123887] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:08.944 [2024-04-26 18:11:18.123896] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:08.944 [2024-04-26 18:11:18.134083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:08.944 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.143896] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.143938] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.143956] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.143966] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.143975] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.154251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.163942] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.163983] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.164003] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.164013] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.164022] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.174251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.183992] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.184031] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.184049] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.184059] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.184068] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.194416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.204063] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.204104] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.204122] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.204132] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.204140] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.214390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.224110] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.224154] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.224172] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.224182] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.224191] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.234431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.244191] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.244229] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.244247] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.244256] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.244265] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.254461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.264207] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.264243] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.264260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.264270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.264279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.274602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.284320] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.284365] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.284383] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.284395] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.284404] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.294585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.304471] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.304516] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.304533] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.304542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.304551] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.203 [2024-04-26 18:11:18.314579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.203 qpair failed and we were unable to recover it. 00:23:09.203 [2024-04-26 18:11:18.324416] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.203 [2024-04-26 18:11:18.324451] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.203 [2024-04-26 18:11:18.324469] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.203 [2024-04-26 18:11:18.324479] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.203 [2024-04-26 18:11:18.324487] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.204 [2024-04-26 18:11:18.334697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.204 qpair failed and we were unable to recover it. 00:23:09.204 [2024-04-26 18:11:18.344515] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.204 [2024-04-26 18:11:18.344556] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.204 [2024-04-26 18:11:18.344573] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.204 [2024-04-26 18:11:18.344583] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.204 [2024-04-26 18:11:18.344591] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.204 [2024-04-26 18:11:18.354765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.204 qpair failed and we were unable to recover it. 00:23:09.204 [2024-04-26 18:11:18.364422] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.204 [2024-04-26 18:11:18.364463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.204 [2024-04-26 18:11:18.364481] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.204 [2024-04-26 18:11:18.364490] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.204 [2024-04-26 18:11:18.364499] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.204 [2024-04-26 18:11:18.374739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.204 qpair failed and we were unable to recover it. 00:23:09.204 [2024-04-26 18:11:18.384600] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.204 [2024-04-26 18:11:18.384648] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.204 [2024-04-26 18:11:18.384666] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.204 [2024-04-26 18:11:18.384675] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.204 [2024-04-26 18:11:18.384684] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.204 [2024-04-26 18:11:18.394980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.204 qpair failed and we were unable to recover it. 00:23:09.462 [2024-04-26 18:11:18.404626] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.462 [2024-04-26 18:11:18.404666] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.462 [2024-04-26 18:11:18.404683] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.462 [2024-04-26 18:11:18.404693] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.462 [2024-04-26 18:11:18.404702] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.415032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.424765] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.424798] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.424815] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.424825] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.424834] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.435080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.444746] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.444786] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.444805] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.444815] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.444824] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.455075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.464804] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.464851] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.464873] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.464883] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.464892] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.475100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.484875] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.484914] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.484932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.484942] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.484950] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.495180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.504895] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.504934] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.504951] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.504961] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.504969] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.515370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.524987] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.525026] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.525043] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.525053] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.525062] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.535219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.544993] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.545039] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.545056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.545066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.545077] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.555314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.565072] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.565110] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.565128] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.565137] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.565146] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.575405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.585106] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.585144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.585162] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.585171] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.585180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.595581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.605176] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.605228] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.605245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.605254] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.605263] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.615553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.625309] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.625357] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.625374] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.625384] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.625392] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.463 [2024-04-26 18:11:18.635661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.463 qpair failed and we were unable to recover it. 00:23:09.463 [2024-04-26 18:11:18.645324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.463 [2024-04-26 18:11:18.645365] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.463 [2024-04-26 18:11:18.645382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.463 [2024-04-26 18:11:18.645392] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.463 [2024-04-26 18:11:18.645400] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.655695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.665405] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.665445] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.665463] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.665472] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.665481] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.675777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.685485] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.685526] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.685543] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.685553] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.685562] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.695776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.705421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.705463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.705481] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.705490] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.705499] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.715854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.725546] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.725584] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.725601] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.725614] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.725623] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.735882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.745787] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.745830] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.745848] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.745858] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.745866] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.756021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.765683] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.765725] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.765743] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.765752] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.765761] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.776096] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.785707] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.785754] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.785771] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.785781] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.785790] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.796065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.805815] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.805855] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.805872] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.805881] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.805890] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.722 [2024-04-26 18:11:18.816129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.722 qpair failed and we were unable to recover it. 00:23:09.722 [2024-04-26 18:11:18.825963] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.722 [2024-04-26 18:11:18.826003] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.722 [2024-04-26 18:11:18.826020] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.722 [2024-04-26 18:11:18.826030] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.722 [2024-04-26 18:11:18.826038] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.723 [2024-04-26 18:11:18.836176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.723 qpair failed and we were unable to recover it. 00:23:09.723 [2024-04-26 18:11:18.845877] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.723 [2024-04-26 18:11:18.845915] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.723 [2024-04-26 18:11:18.845932] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.723 [2024-04-26 18:11:18.845942] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.723 [2024-04-26 18:11:18.845951] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.723 [2024-04-26 18:11:18.856265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.723 qpair failed and we were unable to recover it. 00:23:09.723 [2024-04-26 18:11:18.865960] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.723 [2024-04-26 18:11:18.866000] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.723 [2024-04-26 18:11:18.866018] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.723 [2024-04-26 18:11:18.866027] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.723 [2024-04-26 18:11:18.866036] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.723 [2024-04-26 18:11:18.876428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.723 qpair failed and we were unable to recover it. 00:23:09.723 [2024-04-26 18:11:18.886010] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.723 [2024-04-26 18:11:18.886051] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.723 [2024-04-26 18:11:18.886069] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.723 [2024-04-26 18:11:18.886078] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.723 [2024-04-26 18:11:18.886088] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.723 [2024-04-26 18:11:18.896531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.723 qpair failed and we were unable to recover it. 00:23:09.723 [2024-04-26 18:11:18.906133] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.723 [2024-04-26 18:11:18.906170] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.723 [2024-04-26 18:11:18.906191] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.723 [2024-04-26 18:11:18.906201] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.723 [2024-04-26 18:11:18.906210] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.981 [2024-04-26 18:11:18.916479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.981 qpair failed and we were unable to recover it. 00:23:09.981 [2024-04-26 18:11:18.926182] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.981 [2024-04-26 18:11:18.926222] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.981 [2024-04-26 18:11:18.926239] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.981 [2024-04-26 18:11:18.926248] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.981 [2024-04-26 18:11:18.926257] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.981 [2024-04-26 18:11:18.936458] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.981 qpair failed and we were unable to recover it. 00:23:09.981 [2024-04-26 18:11:18.946249] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.981 [2024-04-26 18:11:18.946291] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.981 [2024-04-26 18:11:18.946309] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.981 [2024-04-26 18:11:18.946318] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.981 [2024-04-26 18:11:18.946327] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.981 [2024-04-26 18:11:18.956625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.981 qpair failed and we were unable to recover it. 00:23:09.981 [2024-04-26 18:11:18.966294] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.981 [2024-04-26 18:11:18.966333] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:18.966354] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:18.966364] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:18.966373] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:18.976626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:18.986354] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:18.986393] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:18.986411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:18.986422] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:18.986435] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:18.996869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.006237] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.006279] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.006296] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.006306] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.006314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.016764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.026483] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.026526] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.026543] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.026553] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.026562] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.036896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.046580] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.046615] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.046633] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.046643] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.046652] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.056922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.066592] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.066635] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.066653] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.066663] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.066672] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.076960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.086661] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.086701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.086718] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.086727] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.086736] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.096981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.106687] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.106728] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.106747] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.106757] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.106766] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.117182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.126774] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.126823] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.126840] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.126851] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.126860] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.137110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.146738] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.146779] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.146796] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.146806] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.146815] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:09.982 [2024-04-26 18:11:19.157213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:09.982 qpair failed and we were unable to recover it. 00:23:09.982 [2024-04-26 18:11:19.166828] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:09.982 [2024-04-26 18:11:19.166870] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:09.982 [2024-04-26 18:11:19.166888] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:09.982 [2024-04-26 18:11:19.166901] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:09.982 [2024-04-26 18:11:19.166910] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.241 [2024-04-26 18:11:19.177220] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.241 qpair failed and we were unable to recover it. 00:23:10.241 [2024-04-26 18:11:19.186957] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.241 [2024-04-26 18:11:19.186999] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.241 [2024-04-26 18:11:19.187016] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.241 [2024-04-26 18:11:19.187026] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.241 [2024-04-26 18:11:19.187035] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.241 [2024-04-26 18:11:19.197353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.241 qpair failed and we were unable to recover it. 00:23:10.241 [2024-04-26 18:11:19.207003] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.241 [2024-04-26 18:11:19.207044] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.241 [2024-04-26 18:11:19.207062] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.241 [2024-04-26 18:11:19.207071] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.241 [2024-04-26 18:11:19.207080] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.241 [2024-04-26 18:11:19.217397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.241 qpair failed and we were unable to recover it. 00:23:10.241 [2024-04-26 18:11:19.226994] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.241 [2024-04-26 18:11:19.227030] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.241 [2024-04-26 18:11:19.227047] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.241 [2024-04-26 18:11:19.227057] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.241 [2024-04-26 18:11:19.227066] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.241 [2024-04-26 18:11:19.237378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.241 qpair failed and we were unable to recover it. 00:23:10.241 [2024-04-26 18:11:19.247087] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.241 [2024-04-26 18:11:19.247128] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.241 [2024-04-26 18:11:19.247145] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.241 [2024-04-26 18:11:19.247154] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.241 [2024-04-26 18:11:19.247163] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.241 [2024-04-26 18:11:19.257531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.241 qpair failed and we were unable to recover it. 00:23:10.241 [2024-04-26 18:11:19.267153] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.241 [2024-04-26 18:11:19.267193] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.241 [2024-04-26 18:11:19.267211] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.267220] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.267229] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.277572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.287200] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.287239] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.287256] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.287266] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.287275] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.297625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.308913] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.308954] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.308972] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.308982] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.308991] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.317604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.327353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.327395] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.327413] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.327423] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.327432] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.337832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.347350] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.347394] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.347415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.347425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.347434] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.357866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.367441] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.367486] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.367504] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.367514] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.367523] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.377781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.387463] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.387501] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.387519] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.387528] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.387537] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.397968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.407572] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.407611] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.407628] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.407638] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.407647] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.242 [2024-04-26 18:11:19.417869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.242 qpair failed and we were unable to recover it. 00:23:10.242 [2024-04-26 18:11:19.427666] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.242 [2024-04-26 18:11:19.427706] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.242 [2024-04-26 18:11:19.427723] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.242 [2024-04-26 18:11:19.427732] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.242 [2024-04-26 18:11:19.427745] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.500 [2024-04-26 18:11:19.438157] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.500 qpair failed and we were unable to recover it. 00:23:10.500 [2024-04-26 18:11:19.447708] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.500 [2024-04-26 18:11:19.447745] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.500 [2024-04-26 18:11:19.447762] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.500 [2024-04-26 18:11:19.447771] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.500 [2024-04-26 18:11:19.447780] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.500 [2024-04-26 18:11:19.457986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.500 qpair failed and we were unable to recover it. 00:23:10.500 [2024-04-26 18:11:19.467765] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.500 [2024-04-26 18:11:19.467804] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.500 [2024-04-26 18:11:19.467821] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.500 [2024-04-26 18:11:19.467831] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.500 [2024-04-26 18:11:19.467840] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.500 [2024-04-26 18:11:19.478251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.500 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.487795] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.487836] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.487853] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.487863] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.487872] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.498164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.507826] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.507871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.507888] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.507898] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.507907] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.518293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.527867] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.527905] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.527922] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.527932] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.527941] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.538437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.547966] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.548005] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.548022] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.548032] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.548041] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.558424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.568012] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.568054] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.568071] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.568082] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.568091] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.578484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.588074] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.588117] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.588134] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.588144] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.588153] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.598489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.608203] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.608244] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.608262] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.608275] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.608284] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.618562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.628214] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.628253] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.628272] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.628282] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.628290] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.638690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.648258] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.648299] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.648317] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.648326] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.648335] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.658555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.668392] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.668431] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.668448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.668457] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.668466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.501 [2024-04-26 18:11:19.678782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.501 qpair failed and we were unable to recover it. 00:23:10.501 [2024-04-26 18:11:19.688443] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.501 [2024-04-26 18:11:19.688484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.501 [2024-04-26 18:11:19.688500] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.501 [2024-04-26 18:11:19.688510] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.501 [2024-04-26 18:11:19.688519] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.698853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.708437] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.708490] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.708507] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.708517] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.708526] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.718752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.728575] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.728619] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.728637] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.728646] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.728655] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.738938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.748580] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.748621] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.748638] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.748647] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.748656] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.759084] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.768612] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.768653] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.768670] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.768680] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.768688] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.778869] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.788720] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.788759] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.788779] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.788789] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.788798] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.799112] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.808768] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.808806] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.808824] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.808833] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.808842] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.819221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.828818] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.828856] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.828873] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.828883] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.828891] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.839046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.848932] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.848967] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.848985] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.848995] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.849004] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.859162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.868985] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.869022] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.869039] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.869049] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.869061] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.879249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.889049] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.889090] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.761 [2024-04-26 18:11:19.889107] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.761 [2024-04-26 18:11:19.889116] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.761 [2024-04-26 18:11:19.889124] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.761 [2024-04-26 18:11:19.899412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.761 qpair failed and we were unable to recover it. 00:23:10.761 [2024-04-26 18:11:19.909122] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.761 [2024-04-26 18:11:19.909168] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.762 [2024-04-26 18:11:19.909186] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.762 [2024-04-26 18:11:19.909196] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.762 [2024-04-26 18:11:19.909205] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.762 [2024-04-26 18:11:19.919369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.762 qpair failed and we were unable to recover it. 00:23:10.762 [2024-04-26 18:11:19.929239] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.762 [2024-04-26 18:11:19.929287] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.762 [2024-04-26 18:11:19.929306] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.762 [2024-04-26 18:11:19.929316] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.762 [2024-04-26 18:11:19.929326] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:10.762 [2024-04-26 18:11:19.939557] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:10.762 qpair failed and we were unable to recover it. 00:23:10.762 [2024-04-26 18:11:19.949302] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:10.762 [2024-04-26 18:11:19.949343] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:10.762 [2024-04-26 18:11:19.949362] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:10.762 [2024-04-26 18:11:19.949372] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:10.762 [2024-04-26 18:11:19.949382] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:19.959571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:19.969270] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:19.969310] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:19.969326] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:19.969341] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:19.969350] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:19.979611] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:19.989358] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:19.989401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:19.989419] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:19.989428] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:19.989437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:19.999755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.009529] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.009584] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.009602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.009613] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.009623] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.019860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.029547] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.029595] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.029613] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.029623] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.029632] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.040004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.049582] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.049628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.049647] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.049661] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.049670] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.059765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.069469] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.069515] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.069532] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.069542] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.069551] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.080054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.089577] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.089637] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.089655] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.089665] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.089675] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.099973] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.109697] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.109738] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.109756] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.109765] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.109774] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.119989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.129697] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.129755] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.129775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.129786] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.129795] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.140229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.149813] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.149860] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.149877] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.149887] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.149896] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.160038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.169939] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.169978] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.169996] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.170005] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.021 [2024-04-26 18:11:20.170015] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.021 [2024-04-26 18:11:20.180321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.021 qpair failed and we were unable to recover it. 00:23:11.021 [2024-04-26 18:11:20.190092] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.021 [2024-04-26 18:11:20.190127] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.021 [2024-04-26 18:11:20.190145] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.021 [2024-04-26 18:11:20.190155] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.022 [2024-04-26 18:11:20.190164] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.022 [2024-04-26 18:11:20.200398] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.022 qpair failed and we were unable to recover it. 00:23:11.022 [2024-04-26 18:11:20.209935] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.022 [2024-04-26 18:11:20.209977] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.022 [2024-04-26 18:11:20.209996] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.022 [2024-04-26 18:11:20.210007] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.022 [2024-04-26 18:11:20.210017] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.220462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.230131] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.230178] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.230216] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.230227] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.230237] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.240301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.250105] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.250144] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.250161] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.250171] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.250180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.260577] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.270164] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.270198] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.270215] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.270224] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.270234] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.280568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.290263] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.290301] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.290318] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.290327] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.290347] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.300586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.310299] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.310361] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.310379] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.310390] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.310404] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.320689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.330309] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.330350] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.330367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.330377] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.330386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.340703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.350373] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.350408] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.350426] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.350435] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.350443] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.360818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.370411] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.370453] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.370470] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.370479] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.370488] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.381014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.390527] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.390570] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.390587] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.390596] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.390605] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.401101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.410621] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.410661] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.410678] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.410688] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.410697] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.280 [2024-04-26 18:11:20.421027] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.280 qpair failed and we were unable to recover it. 00:23:11.280 [2024-04-26 18:11:20.430693] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.280 [2024-04-26 18:11:20.430731] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.280 [2024-04-26 18:11:20.430749] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.280 [2024-04-26 18:11:20.430759] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.280 [2024-04-26 18:11:20.430768] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.281 [2024-04-26 18:11:20.441040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.281 qpair failed and we were unable to recover it. 00:23:11.281 [2024-04-26 18:11:20.450785] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.281 [2024-04-26 18:11:20.450822] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.281 [2024-04-26 18:11:20.450839] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.281 [2024-04-26 18:11:20.450849] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.281 [2024-04-26 18:11:20.450858] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.281 [2024-04-26 18:11:20.460940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.281 qpair failed and we were unable to recover it. 00:23:11.281 [2024-04-26 18:11:20.470909] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.281 [2024-04-26 18:11:20.470949] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.281 [2024-04-26 18:11:20.470967] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.281 [2024-04-26 18:11:20.470977] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.281 [2024-04-26 18:11:20.470987] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.481233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.490959] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.490998] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.491015] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.491028] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.491037] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.501216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.510950] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.510982] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.510999] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.511008] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.511017] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.521224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.530900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.530939] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.530956] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.530965] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.530974] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.541367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.551069] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.551110] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.551126] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.551136] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.551145] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.561333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.571066] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.571106] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.571123] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.571132] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.571141] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.581482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.591137] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.591174] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.591191] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.591201] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.591210] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.601556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.611068] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.611109] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.611126] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.611136] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.611145] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.621580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.631322] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.631375] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.631393] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.631403] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.631412] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.539 [2024-04-26 18:11:20.641726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.539 qpair failed and we were unable to recover it. 00:23:11.539 [2024-04-26 18:11:20.651391] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.539 [2024-04-26 18:11:20.651431] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.539 [2024-04-26 18:11:20.651448] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.539 [2024-04-26 18:11:20.651457] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.539 [2024-04-26 18:11:20.651466] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.540 [2024-04-26 18:11:20.661670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.540 qpair failed and we were unable to recover it. 00:23:11.540 [2024-04-26 18:11:20.671396] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.540 [2024-04-26 18:11:20.671434] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.540 [2024-04-26 18:11:20.671454] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.540 [2024-04-26 18:11:20.671464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.540 [2024-04-26 18:11:20.671472] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.540 [2024-04-26 18:11:20.681835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.540 qpair failed and we were unable to recover it. 00:23:11.540 [2024-04-26 18:11:20.691398] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.540 [2024-04-26 18:11:20.691438] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.540 [2024-04-26 18:11:20.691455] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.540 [2024-04-26 18:11:20.691464] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.540 [2024-04-26 18:11:20.691473] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.540 [2024-04-26 18:11:20.701768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.540 qpair failed and we were unable to recover it. 00:23:11.540 [2024-04-26 18:11:20.711468] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.540 [2024-04-26 18:11:20.711510] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.540 [2024-04-26 18:11:20.711528] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.540 [2024-04-26 18:11:20.711537] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.540 [2024-04-26 18:11:20.711546] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.540 [2024-04-26 18:11:20.721843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.540 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.731544] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.731594] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.731612] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.731622] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.731632] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.742021] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.751593] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.751633] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.751650] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.751660] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.751672] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.762175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.771868] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.771911] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.771928] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.771938] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.771947] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.782085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.791750] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.791793] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.791810] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.791820] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.791829] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.802106] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.811777] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.811814] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.811833] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.811843] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.811852] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.822316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.831906] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.831944] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.831962] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.831972] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.831981] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.842252] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.851852] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.851894] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.851911] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.851921] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.851930] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.798 [2024-04-26 18:11:20.862289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.798 qpair failed and we were unable to recover it. 00:23:11.798 [2024-04-26 18:11:20.871984] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.798 [2024-04-26 18:11:20.872027] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.798 [2024-04-26 18:11:20.872045] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.798 [2024-04-26 18:11:20.872054] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.798 [2024-04-26 18:11:20.872063] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.882400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:11.799 [2024-04-26 18:11:20.892035] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.799 [2024-04-26 18:11:20.892075] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.799 [2024-04-26 18:11:20.892094] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.799 [2024-04-26 18:11:20.892104] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.799 [2024-04-26 18:11:20.892113] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.902511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:11.799 [2024-04-26 18:11:20.912017] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.799 [2024-04-26 18:11:20.912056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.799 [2024-04-26 18:11:20.912073] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.799 [2024-04-26 18:11:20.912083] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.799 [2024-04-26 18:11:20.912092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.922469] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:11.799 [2024-04-26 18:11:20.932159] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.799 [2024-04-26 18:11:20.932201] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.799 [2024-04-26 18:11:20.932219] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.799 [2024-04-26 18:11:20.932232] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.799 [2024-04-26 18:11:20.932240] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.942451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:11.799 [2024-04-26 18:11:20.952222] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.799 [2024-04-26 18:11:20.952261] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.799 [2024-04-26 18:11:20.952278] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.799 [2024-04-26 18:11:20.952287] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.799 [2024-04-26 18:11:20.952296] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.962664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:11.799 [2024-04-26 18:11:20.972293] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:11.799 [2024-04-26 18:11:20.972335] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:11.799 [2024-04-26 18:11:20.972356] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:11.799 [2024-04-26 18:11:20.972367] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:11.799 [2024-04-26 18:11:20.972376] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:11.799 [2024-04-26 18:11:20.982589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:11.799 qpair failed and we were unable to recover it. 00:23:12.057 [2024-04-26 18:11:20.992182] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.057 [2024-04-26 18:11:20.992221] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.057 [2024-04-26 18:11:20.992239] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.057 [2024-04-26 18:11:20.992248] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.057 [2024-04-26 18:11:20.992257] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.057 [2024-04-26 18:11:21.002652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.057 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.012482] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.012523] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.012540] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.012550] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.012559] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.022799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.032455] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.032499] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.032517] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.032526] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.032535] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.042948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.052510] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.052544] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.052562] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.052572] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.052581] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.062889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.072715] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.072753] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.072770] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.072780] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.072789] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.082951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.092593] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.092632] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.092650] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.092660] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.092669] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.102770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.112600] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.112643] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.112664] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.112674] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.112683] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.123260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.132644] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.132688] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.132706] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.132716] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.132725] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.143003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.152779] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.152819] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.152836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.152846] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.152855] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.163152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.172838] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.172885] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.172903] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.172912] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.172921] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.183297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.192910] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.192953] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.192970] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.192979] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.192992] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.203352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.212891] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.212924] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.212942] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.212952] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.212961] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.223314] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.058 [2024-04-26 18:11:21.233006] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.058 [2024-04-26 18:11:21.233047] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.058 [2024-04-26 18:11:21.233065] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.058 [2024-04-26 18:11:21.233074] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.058 [2024-04-26 18:11:21.233083] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.058 [2024-04-26 18:11:21.243658] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.058 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.253017] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.317 [2024-04-26 18:11:21.253062] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.317 [2024-04-26 18:11:21.253082] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.317 [2024-04-26 18:11:21.253094] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.317 [2024-04-26 18:11:21.253105] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.317 [2024-04-26 18:11:21.263499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.317 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.273158] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.317 [2024-04-26 18:11:21.273203] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.317 [2024-04-26 18:11:21.273220] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.317 [2024-04-26 18:11:21.273230] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.317 [2024-04-26 18:11:21.273239] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.317 [2024-04-26 18:11:21.283455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.317 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.293124] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.317 [2024-04-26 18:11:21.293165] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.317 [2024-04-26 18:11:21.293185] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.317 [2024-04-26 18:11:21.293198] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.317 [2024-04-26 18:11:21.293209] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.317 [2024-04-26 18:11:21.303573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.317 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.313245] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.317 [2024-04-26 18:11:21.313278] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.317 [2024-04-26 18:11:21.313296] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.317 [2024-04-26 18:11:21.313305] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.317 [2024-04-26 18:11:21.313314] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.317 [2024-04-26 18:11:21.323626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.317 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.333176] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.317 [2024-04-26 18:11:21.333216] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.317 [2024-04-26 18:11:21.333234] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.317 [2024-04-26 18:11:21.333244] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.317 [2024-04-26 18:11:21.333253] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.317 [2024-04-26 18:11:21.343591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.317 qpair failed and we were unable to recover it. 00:23:12.317 [2024-04-26 18:11:21.353355] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.353401] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.353418] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.353428] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.353437] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.363854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.373399] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.373436] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.373454] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.373468] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.373477] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.383763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.393586] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.393628] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.393646] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.393656] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.393664] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.403987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.413422] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.413463] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.413481] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.413491] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.413499] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.423936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.433627] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.433671] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.433688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.433698] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.433707] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.444101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.453627] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.453664] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.453682] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.453691] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.453700] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.464032] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.473857] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.473888] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.473906] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.473916] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.473924] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.484165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.318 [2024-04-26 18:11:21.493916] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.318 [2024-04-26 18:11:21.493958] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.318 [2024-04-26 18:11:21.493976] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.318 [2024-04-26 18:11:21.493986] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.318 [2024-04-26 18:11:21.493995] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.318 [2024-04-26 18:11:21.504131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.318 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.513935] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.513995] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.514014] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.514024] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.514034] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.524226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.533902] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.533945] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.533963] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.533973] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.533982] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.544171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.554000] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.554036] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.554056] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.554066] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.554075] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.564421] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.574119] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.574159] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.574177] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.574187] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.574196] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.584248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.594208] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.594250] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.594267] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.594276] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.594286] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.604388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.614109] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.614150] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.614169] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.614178] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.614187] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.624360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.634192] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.634233] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.634251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.634260] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.634273] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.644504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.654311] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.654357] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.654375] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.654385] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.654394] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.664499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.674368] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.674413] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.674431] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.674441] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.674450] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.684817] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.694368] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.694405] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.694423] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.694433] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.694441] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.704434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.714558] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.714601] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.714618] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.714627] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.714636] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.724959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.734548] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.734599] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.734617] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.734627] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.734636] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.744868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.577 [2024-04-26 18:11:21.754614] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.577 [2024-04-26 18:11:21.754658] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.577 [2024-04-26 18:11:21.754675] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.577 [2024-04-26 18:11:21.754685] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.577 [2024-04-26 18:11:21.754694] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.577 [2024-04-26 18:11:21.764986] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.577 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.774660] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.774701] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.774719] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.774729] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.774738] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.785056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.794700] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.794738] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.794755] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.794765] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.794774] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.805221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.814719] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.814757] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.814775] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.814788] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.814798] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.825050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.834873] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.834917] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.834936] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.834945] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.834954] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.845036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.854783] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.854817] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.854836] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.854846] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.854855] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.865212] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.874979] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.835 [2024-04-26 18:11:21.875023] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.835 [2024-04-26 18:11:21.875041] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.835 [2024-04-26 18:11:21.875050] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.835 [2024-04-26 18:11:21.875059] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.835 [2024-04-26 18:11:21.885298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.835 qpair failed and we were unable to recover it. 00:23:12.835 [2024-04-26 18:11:21.895058] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.895097] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.895116] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.895126] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.895135] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:21.905340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:21.915027] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.915067] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.915085] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.915094] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.915103] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:21.925489] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:21.935039] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.935078] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.935096] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.935106] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.935115] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:21.945487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:21.955009] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.955050] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.955067] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.955077] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.955086] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:21.965495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:21.975124] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.975162] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.975180] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.975189] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.975198] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:21.985405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:21.995193] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:21.995240] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:21.995260] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:21.995270] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:21.995279] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:22.005606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:12.836 [2024-04-26 18:11:22.015231] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:12.836 [2024-04-26 18:11:22.015267] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:12.836 [2024-04-26 18:11:22.015286] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:12.836 [2024-04-26 18:11:22.015298] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:12.836 [2024-04-26 18:11:22.015310] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:12.836 [2024-04-26 18:11:22.025728] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:12.836 qpair failed and we were unable to recover it. 00:23:13.094 [2024-04-26 18:11:22.035440] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.094 [2024-04-26 18:11:22.035484] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.094 [2024-04-26 18:11:22.035501] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.094 [2024-04-26 18:11:22.035511] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.094 [2024-04-26 18:11:22.035520] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.094 [2024-04-26 18:11:22.045576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.094 qpair failed and we were unable to recover it. 00:23:13.094 [2024-04-26 18:11:22.055355] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.094 [2024-04-26 18:11:22.055397] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.094 [2024-04-26 18:11:22.055415] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.094 [2024-04-26 18:11:22.055425] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.094 [2024-04-26 18:11:22.055434] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.065843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.075594] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.075638] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.075656] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.075666] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.075678] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.085803] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.095547] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.095588] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.095605] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.095614] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.095623] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.106066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.115475] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.115520] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.115538] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.115548] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.115556] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.125959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.135637] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.135680] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.135698] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.135707] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.135716] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.146030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.155677] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.155728] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.155746] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.155756] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.155765] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.166151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.175795] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.175839] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.175856] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.175866] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.175875] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.186240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.195760] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.195797] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.195815] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.195825] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.195833] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.206369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.215896] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.215935] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.215953] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.215963] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.215972] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.226365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.235928] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.235971] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.235988] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.235998] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.236007] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.246340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.255927] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.255973] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.255992] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.256007] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.256018] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.266182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.095 [2024-04-26 18:11:22.276091] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.095 [2024-04-26 18:11:22.276130] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.095 [2024-04-26 18:11:22.276148] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.095 [2024-04-26 18:11:22.276158] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.095 [2024-04-26 18:11:22.276167] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.095 [2024-04-26 18:11:22.286348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.095 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.296083] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.296124] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.296142] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.296152] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.296160] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.306560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.316179] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.316228] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.316245] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.316255] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.316264] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.326531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.336132] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.336175] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.336195] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.336207] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.336219] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.346643] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.356324] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.356366] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.356384] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.356394] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.356403] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.366688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.376308] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.376360] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.376382] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.376398] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.376409] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.386633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.396421] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.396469] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.396486] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.396496] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.396505] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.406940] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.354 qpair failed and we were unable to recover it. 00:23:13.354 [2024-04-26 18:11:22.416441] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.354 [2024-04-26 18:11:22.416480] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.354 [2024-04-26 18:11:22.416498] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.354 [2024-04-26 18:11:22.416508] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.354 [2024-04-26 18:11:22.416517] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.354 [2024-04-26 18:11:22.426811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.436570] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.436604] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.436626] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.436636] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.436645] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.355 [2024-04-26 18:11:22.447133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.456591] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.456630] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.456648] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.456657] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.456667] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.355 [2024-04-26 18:11:22.466974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.476694] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.476733] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.476751] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.476760] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.476769] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.355 [2024-04-26 18:11:22.487030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.496635] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.496670] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.496688] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.496698] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.496706] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.355 [2024-04-26 18:11:22.507045] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.516772] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.516814] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.516831] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.516841] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.516853] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.355 [2024-04-26 18:11:22.527269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.355 qpair failed and we were unable to recover it. 00:23:13.355 [2024-04-26 18:11:22.536741] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.355 [2024-04-26 18:11:22.536782] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.355 [2024-04-26 18:11:22.536800] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.355 [2024-04-26 18:11:22.536810] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.355 [2024-04-26 18:11:22.536818] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.613 [2024-04-26 18:11:22.547263] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.613 qpair failed and we were unable to recover it. 00:23:13.613 [2024-04-26 18:11:22.556878] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.613 [2024-04-26 18:11:22.556922] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.613 [2024-04-26 18:11:22.556939] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.556949] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.556958] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.567429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.576900] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.576935] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.576953] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.576963] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.576972] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.587313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.597024] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.597056] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.597074] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.597083] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.597092] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.607350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.617008] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.617048] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.617068] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.617080] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.617091] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.627329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.637178] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.637224] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.637242] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.637252] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.637261] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.647437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.657096] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.657138] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.657157] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.657169] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.657180] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.667667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.677268] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.677310] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.677328] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.677343] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.677352] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.687672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.697240] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.697276] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.697294] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.697307] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.697316] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.707670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.717374] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.717419] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.717437] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.717446] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.717455] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.727794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.737353] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.737391] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.737411] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.737423] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.737433] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.747878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.757536] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.757585] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.757602] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.757612] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.757621] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.767905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.777573] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.777614] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.777632] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.777641] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.777650] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.614 [2024-04-26 18:11:22.787916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.614 qpair failed and we were unable to recover it. 00:23:13.614 [2024-04-26 18:11:22.797644] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.614 [2024-04-26 18:11:22.797688] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.614 [2024-04-26 18:11:22.797705] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.614 [2024-04-26 18:11:22.797715] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.614 [2024-04-26 18:11:22.797724] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.807917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.817605] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.817644] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.817662] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.817671] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.817680] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.827991] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.837739] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.837778] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.837796] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.837806] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.837815] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.848069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.857620] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.857659] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.857677] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.857687] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.857696] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.868143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.877826] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.877867] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.877887] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.877897] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.877906] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.888296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.897770] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.897807] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.897827] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.897837] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.897846] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.908299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.917931] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.917964] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.917982] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.917992] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.918000] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.928400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.937958] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.937997] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.938016] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.938025] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.938034] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.948478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.958025] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.958063] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.958080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.958090] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.958102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.968409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.978019] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.978061] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.978080] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.978092] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.978102] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:22.988392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:22.998126] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:22.998164] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:22.998181] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:22.998191] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:22.998201] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:23.008547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:23.018193] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:23.018231] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:23.018251] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:23.018262] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:23.018273] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.873 [2024-04-26 18:11:23.028661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.873 qpair failed and we were unable to recover it. 00:23:13.873 [2024-04-26 18:11:23.038302] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.873 [2024-04-26 18:11:23.038349] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.873 [2024-04-26 18:11:23.038367] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.873 [2024-04-26 18:11:23.038377] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.873 [2024-04-26 18:11:23.038386] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:13.874 [2024-04-26 18:11:23.048737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:13.874 qpair failed and we were unable to recover it. 00:23:13.874 [2024-04-26 18:11:23.058254] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:13.874 [2024-04-26 18:11:23.058293] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:13.874 [2024-04-26 18:11:23.058313] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:13.874 [2024-04-26 18:11:23.058325] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:13.874 [2024-04-26 18:11:23.058341] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:14.131 [2024-04-26 18:11:23.068806] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:14.131 qpair failed and we were unable to recover it. 00:23:14.131 [2024-04-26 18:11:23.078523] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:14.131 [2024-04-26 18:11:23.078559] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:14.131 [2024-04-26 18:11:23.078576] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:14.131 [2024-04-26 18:11:23.078586] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:14.131 [2024-04-26 18:11:23.078595] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:14.131 [2024-04-26 18:11:23.088713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:14.131 qpair failed and we were unable to recover it. 00:23:14.131 [2024-04-26 18:11:23.098535] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:14.131 [2024-04-26 18:11:23.098576] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:14.131 [2024-04-26 18:11:23.098593] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:14.131 [2024-04-26 18:11:23.098603] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:14.131 [2024-04-26 18:11:23.098612] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d3080 00:23:14.131 [2024-04-26 18:11:23.108842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:14.131 qpair failed and we were unable to recover it. 00:23:15.061 Read completed with error (sct=0, sc=8) 00:23:15.061 starting I/O failed 00:23:15.061 Write completed with error (sct=0, sc=8) 00:23:15.061 starting I/O failed 00:23:15.061 Write completed with error (sct=0, sc=8) 00:23:15.061 starting I/O failed 00:23:15.061 Write completed with error (sct=0, sc=8) 00:23:15.061 starting I/O failed 00:23:15.061 Write completed with error (sct=0, sc=8) 00:23:15.061 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Read completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 Write completed with error (sct=0, sc=8) 00:23:15.062 starting I/O failed 00:23:15.062 [2024-04-26 18:11:24.113790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:15.062 [2024-04-26 18:11:24.121138] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.121186] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.121205] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.121216] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.121226] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:23:15.062 [2024-04-26 18:11:24.131823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.141623] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.141668] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.141686] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.141696] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.141705] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000002d03c0 00:23:15.062 [2024-04-26 18:11:24.151954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.161675] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.161716] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.161736] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.161747] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.161756] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:23:15.062 [2024-04-26 18:11:24.172097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.181679] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.181719] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.181736] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.181746] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.181758] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003cf840 00:23:15.062 [2024-04-26 18:11:24.192169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.192291] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:23:15.062 A controller has encountered a failure and is being reset. 00:23:15.062 [2024-04-26 18:11:24.201820] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.201871] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.201900] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.201916] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.201929] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:15.062 [2024-04-26 18:11:24.212350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.221970] ctrlr.c: 706:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:23:15.062 [2024-04-26 18:11:24.222005] nvme_fabric.c: 600:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:RDMA adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:23:15.062 [2024-04-26 18:11:24.222022] nvme_fabric.c: 611:_nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:23:15.062 [2024-04-26 18:11:24.222032] nvme_rdma.c:1408:nvme_rdma_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:23:15.062 [2024-04-26 18:11:24.222042] nvme_rdma.c:2743:nvme_rdma_qpair_process_completions: *ERROR*: Failed to connect rqpair=0x2000003d4c80 00:23:15.062 [2024-04-26 18:11:24.232168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:15.062 qpair failed and we were unable to recover it. 00:23:15.062 [2024-04-26 18:11:24.232306] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:23:15.320 [2024-04-26 18:11:24.265496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:15.320 Controller properly reset. 00:23:15.320 Initializing NVMe Controllers 00:23:15.320 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:15.320 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:15.320 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:23:15.320 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:23:15.320 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:23:15.320 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:23:15.320 Initialization complete. Launching workers. 00:23:15.320 Starting thread on core 1 00:23:15.320 Starting thread on core 2 00:23:15.320 Starting thread on core 3 00:23:15.320 Starting thread on core 0 00:23:15.320 18:11:24 -- host/target_disconnect.sh@59 -- # sync 00:23:15.320 00:23:15.320 real 0m12.608s 00:23:15.320 user 0m27.008s 00:23:15.320 sys 0m3.382s 00:23:15.320 18:11:24 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:15.320 18:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:15.320 ************************************ 00:23:15.320 END TEST nvmf_target_disconnect_tc2 00:23:15.320 ************************************ 00:23:15.320 18:11:24 -- host/target_disconnect.sh@80 -- # '[' -n 192.168.100.9 ']' 00:23:15.320 18:11:24 -- host/target_disconnect.sh@81 -- # run_test nvmf_target_disconnect_tc3 nvmf_target_disconnect_tc3 00:23:15.320 18:11:24 -- common/autotest_common.sh@1097 -- # '[' 2 -le 1 ']' 00:23:15.320 18:11:24 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:15.320 18:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:15.577 ************************************ 00:23:15.577 START TEST nvmf_target_disconnect_tc3 00:23:15.577 ************************************ 00:23:15.577 18:11:24 -- common/autotest_common.sh@1121 -- # nvmf_target_disconnect_tc3 00:23:15.577 18:11:24 -- host/target_disconnect.sh@65 -- # reconnectpid=1063195 00:23:15.577 18:11:24 -- host/target_disconnect.sh@67 -- # sleep 2 00:23:15.577 18:11:24 -- host/target_disconnect.sh@63 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:rdma adrfam:IPv4 traddr:192.168.100.8 trsvcid:4420 alt_traddr:192.168.100.9' 00:23:15.577 EAL: No free 2048 kB hugepages reported on node 1 00:23:17.474 18:11:26 -- host/target_disconnect.sh@68 -- # kill -9 1062237 00:23:17.474 18:11:26 -- host/target_disconnect.sh@70 -- # sleep 2 00:23:18.846 Read completed with error (sct=0, sc=8) 00:23:18.846 starting I/O failed 00:23:18.846 Read completed with error (sct=0, sc=8) 00:23:18.846 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Write completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 Read completed with error (sct=0, sc=8) 00:23:18.847 starting I/O failed 00:23:18.847 [2024-04-26 18:11:27.709085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:23:19.412 /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 62: 1062237 Killed "${NVMF_APP[@]}" "$@" 00:23:19.412 18:11:28 -- host/target_disconnect.sh@71 -- # disconnect_init 192.168.100.9 00:23:19.412 18:11:28 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:23:19.412 18:11:28 -- nvmf/common.sh@468 -- # timing_enter start_nvmf_tgt 00:23:19.412 18:11:28 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:19.412 18:11:28 -- common/autotest_common.sh@10 -- # set +x 00:23:19.412 18:11:28 -- nvmf/common.sh@470 -- # nvmfpid=1063741 00:23:19.412 18:11:28 -- nvmf/common.sh@471 -- # waitforlisten 1063741 00:23:19.412 18:11:28 -- nvmf/common.sh@469 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:23:19.412 18:11:28 -- common/autotest_common.sh@827 -- # '[' -z 1063741 ']' 00:23:19.412 18:11:28 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.412 18:11:28 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:19.412 18:11:28 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.412 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.412 18:11:28 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:19.412 18:11:28 -- common/autotest_common.sh@10 -- # set +x 00:23:19.412 [2024-04-26 18:11:28.582148] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:23:19.412 [2024-04-26 18:11:28.582206] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.670 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.671 [2024-04-26 18:11:28.671256] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Read completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 Write completed with error (sct=0, sc=8) 00:23:19.671 starting I/O failed 00:23:19.671 [2024-04-26 18:11:28.714069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:23:19.671 [2024-04-26 18:11:28.752131] app.c: 523:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.671 [2024-04-26 18:11:28.752178] app.c: 524:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.671 [2024-04-26 18:11:28.752188] app.c: 529:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only 00:23:19.671 [2024-04-26 18:11:28.752196] app.c: 530:app_setup_trace: *NOTICE*: SPDK application currently running. 00:23:19.671 [2024-04-26 18:11:28.752204] app.c: 531:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.671 [2024-04-26 18:11:28.752322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:23:19.671 [2024-04-26 18:11:28.752425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:23:19.671 [2024-04-26 18:11:28.752526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:23:19.671 [2024-04-26 18:11:28.752528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:23:20.242 18:11:29 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:20.242 18:11:29 -- common/autotest_common.sh@860 -- # return 0 00:23:20.242 18:11:29 -- nvmf/common.sh@472 -- # timing_exit start_nvmf_tgt 00:23:20.242 18:11:29 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:20.242 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 18:11:29 -- nvmf/common.sh@473 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:20.549 18:11:29 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 Malloc0 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t rdma --num-shared-buffers 1024 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 [2024-04-26 18:11:29.498853] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0xb75400/0xb81220) succeed. 00:23:20.549 [2024-04-26 18:11:29.509988] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0xb76a40/0xc01280) succeed. 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t rdma -a 192.168.100.9 -s 4420 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 [2024-04-26 18:11:29.656808] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.9 port 4420 *** 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t rdma -a 192.168.100.9 -s 4420 00:23:20.549 18:11:29 -- common/autotest_common.sh@559 -- # xtrace_disable 00:23:20.549 18:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:20.549 18:11:29 -- common/autotest_common.sh@587 -- # [[ 0 == 0 ]] 00:23:20.549 18:11:29 -- host/target_disconnect.sh@73 -- # wait 1063195 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Read completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 Write completed with error (sct=0, sc=8) 00:23:20.549 starting I/O failed 00:23:20.549 [2024-04-26 18:11:29.719235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Read completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.924 Write completed with error (sct=0, sc=8) 00:23:21.924 starting I/O failed 00:23:21.925 Read completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 Read completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 Write completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 Read completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 Write completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 Write completed with error (sct=0, sc=8) 00:23:21.925 starting I/O failed 00:23:21.925 [2024-04-26 18:11:30.724241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:23:21.925 [2024-04-26 18:11:30.724262] nvme_ctrlr.c:4340:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:23:21.925 A controller has encountered a failure and is being reset. 00:23:21.925 Resorting to new failover address 192.168.100.9 00:23:21.925 [2024-04-26 18:11:30.724373] nvme_ctrlr.c:1041:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:23:21.925 [2024-04-26 18:11:30.724448] nvme_rdma.c: 621:nvme_rdma_validate_cm_event: *ERROR*: Expected RDMA_CM_EVENT_DISCONNECTED but received RDMA_CM_EVENT_TIMEWAIT_EXIT (15) from CM event channel (status = 0) 00:23:21.925 [2024-04-26 18:11:30.754436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 0 00:23:21.925 Controller properly reset. 00:23:26.110 Initializing NVMe Controllers 00:23:26.110 Attaching to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:26.110 Attached to NVMe over Fabrics controller at 192.168.100.8:4420: nqn.2016-06.io.spdk:cnode1 00:23:26.110 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:23:26.110 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:23:26.110 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:23:26.110 Associating RDMA (addr:192.168.100.8 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:23:26.110 Initialization complete. Launching workers. 00:23:26.110 Starting thread on core 1 00:23:26.110 Starting thread on core 2 00:23:26.110 Starting thread on core 3 00:23:26.110 Starting thread on core 0 00:23:26.110 18:11:34 -- host/target_disconnect.sh@74 -- # sync 00:23:26.110 00:23:26.110 real 0m10.282s 00:23:26.110 user 1m3.414s 00:23:26.110 sys 0m1.954s 00:23:26.110 18:11:34 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:26.110 18:11:34 -- common/autotest_common.sh@10 -- # set +x 00:23:26.110 ************************************ 00:23:26.110 END TEST nvmf_target_disconnect_tc3 00:23:26.110 ************************************ 00:23:26.110 18:11:34 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:23:26.110 18:11:34 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:23:26.110 18:11:34 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:26.110 18:11:34 -- nvmf/common.sh@117 -- # sync 00:23:26.110 18:11:34 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:26.110 18:11:34 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:26.110 18:11:34 -- nvmf/common.sh@120 -- # set +e 00:23:26.110 18:11:34 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:26.110 18:11:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:26.110 rmmod nvme_rdma 00:23:26.110 rmmod nvme_fabrics 00:23:26.110 18:11:34 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:26.110 18:11:34 -- nvmf/common.sh@124 -- # set -e 00:23:26.110 18:11:34 -- nvmf/common.sh@125 -- # return 0 00:23:26.110 18:11:34 -- nvmf/common.sh@478 -- # '[' -n 1063741 ']' 00:23:26.110 18:11:34 -- nvmf/common.sh@479 -- # killprocess 1063741 00:23:26.110 18:11:34 -- common/autotest_common.sh@946 -- # '[' -z 1063741 ']' 00:23:26.110 18:11:34 -- common/autotest_common.sh@950 -- # kill -0 1063741 00:23:26.110 18:11:34 -- common/autotest_common.sh@951 -- # uname 00:23:26.110 18:11:34 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:26.110 18:11:34 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1063741 00:23:26.110 18:11:34 -- common/autotest_common.sh@952 -- # process_name=reactor_4 00:23:26.110 18:11:34 -- common/autotest_common.sh@956 -- # '[' reactor_4 = sudo ']' 00:23:26.110 18:11:34 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1063741' 00:23:26.110 killing process with pid 1063741 00:23:26.110 18:11:34 -- common/autotest_common.sh@965 -- # kill 1063741 00:23:26.110 18:11:34 -- common/autotest_common.sh@970 -- # wait 1063741 00:23:26.110 [2024-04-26 18:11:35.022102] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:26.110 18:11:35 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:26.110 18:11:35 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:26.110 00:23:26.110 real 0m31.424s 00:23:26.110 user 1m58.721s 00:23:26.110 sys 0m11.086s 00:23:26.110 18:11:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:26.110 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.110 ************************************ 00:23:26.110 END TEST nvmf_target_disconnect 00:23:26.110 ************************************ 00:23:26.369 18:11:35 -- nvmf/nvmf.sh@123 -- # timing_exit host 00:23:26.369 18:11:35 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:26.369 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.369 18:11:35 -- nvmf/nvmf.sh@125 -- # trap - SIGINT SIGTERM EXIT 00:23:26.369 00:23:26.369 real 16m8.874s 00:23:26.369 user 40m30.512s 00:23:26.369 sys 4m38.638s 00:23:26.369 18:11:35 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:26.369 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.369 ************************************ 00:23:26.369 END TEST nvmf_rdma 00:23:26.369 ************************************ 00:23:26.369 18:11:35 -- spdk/autotest.sh@283 -- # run_test spdkcli_nvmf_rdma /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:23:26.369 18:11:35 -- common/autotest_common.sh@1097 -- # '[' 3 -le 1 ']' 00:23:26.369 18:11:35 -- common/autotest_common.sh@1103 -- # xtrace_disable 00:23:26.369 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.628 ************************************ 00:23:26.628 START TEST spdkcli_nvmf_rdma 00:23:26.628 ************************************ 00:23:26.628 18:11:35 -- common/autotest_common.sh@1121 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=rdma 00:23:26.628 * Looking for test storage... 00:23:26.628 * Found test storage at /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli 00:23:26.628 18:11:35 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/common.sh 00:23:26.628 18:11:35 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:23:26.628 18:11:35 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-phy-autotest/spdk/test/json_config/clear_config.py 00:23:26.628 18:11:35 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/nvmf/common.sh 00:23:26.628 18:11:35 -- nvmf/common.sh@7 -- # uname -s 00:23:26.628 18:11:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:26.628 18:11:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:26.628 18:11:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:26.628 18:11:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:26.628 18:11:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:26.628 18:11:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:26.629 18:11:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:26.629 18:11:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:26.629 18:11:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:26.629 18:11:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:26.629 18:11:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:0049fda6-1adc-e711-906e-0017a4403562 00:23:26.629 18:11:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=0049fda6-1adc-e711-906e-0017a4403562 00:23:26.629 18:11:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:26.629 18:11:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:26.629 18:11:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:26.629 18:11:35 -- nvmf/common.sh@22 -- # NVME_SUBNQN=nqn.2016-06.io.spdk:testnqn 00:23:26.629 18:11:35 -- nvmf/common.sh@45 -- # source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:23:26.629 18:11:35 -- scripts/common.sh@508 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:26.629 18:11:35 -- scripts/common.sh@516 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:26.629 18:11:35 -- scripts/common.sh@517 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:26.629 18:11:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.629 18:11:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.629 18:11:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.629 18:11:35 -- paths/export.sh@5 -- # export PATH 00:23:26.629 18:11:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:26.629 18:11:35 -- nvmf/common.sh@47 -- # : 0 00:23:26.629 18:11:35 -- nvmf/common.sh@48 -- # export NVMF_APP_SHM_ID 00:23:26.629 18:11:35 -- nvmf/common.sh@49 -- # build_nvmf_app_args 00:23:26.629 18:11:35 -- nvmf/common.sh@25 -- # '[' 0 -eq 1 ']' 00:23:26.629 18:11:35 -- nvmf/common.sh@29 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:26.629 18:11:35 -- nvmf/common.sh@31 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:26.629 18:11:35 -- nvmf/common.sh@33 -- # '[' -n '' ']' 00:23:26.629 18:11:35 -- nvmf/common.sh@35 -- # '[' 0 -eq 1 ']' 00:23:26.629 18:11:35 -- nvmf/common.sh@51 -- # have_pci_nics=0 00:23:26.629 18:11:35 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:23:26.629 18:11:35 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:23:26.629 18:11:35 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:23:26.629 18:11:35 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:23:26.629 18:11:35 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:26.629 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.629 18:11:35 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:23:26.629 18:11:35 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=1064777 00:23:26.629 18:11:35 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:23:26.629 18:11:35 -- spdkcli/common.sh@34 -- # waitforlisten 1064777 00:23:26.629 18:11:35 -- common/autotest_common.sh@827 -- # '[' -z 1064777 ']' 00:23:26.629 18:11:35 -- common/autotest_common.sh@831 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:26.629 18:11:35 -- common/autotest_common.sh@832 -- # local max_retries=100 00:23:26.629 18:11:35 -- common/autotest_common.sh@834 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:26.629 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:26.629 18:11:35 -- common/autotest_common.sh@836 -- # xtrace_disable 00:23:26.629 18:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:26.629 [2024-04-26 18:11:35.748943] Starting SPDK v24.05-pre git sha1 c1efd80ca / DPDK 23.11.0 initialization... 00:23:26.629 [2024-04-26 18:11:35.749001] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1064777 ] 00:23:26.629 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.887 [2024-04-26 18:11:35.821397] app.c: 828:spdk_app_start: *NOTICE*: Total cores available: 2 00:23:26.887 [2024-04-26 18:11:35.911484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:26.887 [2024-04-26 18:11:35.911488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:27.456 18:11:36 -- common/autotest_common.sh@856 -- # (( i == 0 )) 00:23:27.456 18:11:36 -- common/autotest_common.sh@860 -- # return 0 00:23:27.456 18:11:36 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:23:27.456 18:11:36 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:27.456 18:11:36 -- common/autotest_common.sh@10 -- # set +x 00:23:27.456 18:11:36 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:23:27.456 18:11:36 -- spdkcli/nvmf.sh@22 -- # [[ rdma == \r\d\m\a ]] 00:23:27.456 18:11:36 -- spdkcli/nvmf.sh@23 -- # nvmftestinit 00:23:27.456 18:11:36 -- nvmf/common.sh@430 -- # '[' -z rdma ']' 00:23:27.456 18:11:36 -- nvmf/common.sh@435 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:27.456 18:11:36 -- nvmf/common.sh@437 -- # prepare_net_devs 00:23:27.456 18:11:36 -- nvmf/common.sh@399 -- # local -g is_hw=no 00:23:27.456 18:11:36 -- nvmf/common.sh@401 -- # remove_spdk_ns 00:23:27.456 18:11:36 -- nvmf/common.sh@617 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.456 18:11:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:23:27.456 18:11:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:27.456 18:11:36 -- nvmf/common.sh@403 -- # [[ phy != virt ]] 00:23:27.456 18:11:36 -- nvmf/common.sh@403 -- # gather_supported_nvmf_pci_devs 00:23:27.456 18:11:36 -- nvmf/common.sh@285 -- # xtrace_disable 00:23:27.456 18:11:36 -- common/autotest_common.sh@10 -- # set +x 00:23:34.037 18:11:42 -- nvmf/common.sh@289 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:34.037 18:11:42 -- nvmf/common.sh@291 -- # pci_devs=() 00:23:34.037 18:11:42 -- nvmf/common.sh@291 -- # local -a pci_devs 00:23:34.037 18:11:42 -- nvmf/common.sh@292 -- # pci_net_devs=() 00:23:34.037 18:11:42 -- nvmf/common.sh@292 -- # local -a pci_net_devs 00:23:34.037 18:11:42 -- nvmf/common.sh@293 -- # pci_drivers=() 00:23:34.037 18:11:42 -- nvmf/common.sh@293 -- # local -A pci_drivers 00:23:34.037 18:11:42 -- nvmf/common.sh@295 -- # net_devs=() 00:23:34.037 18:11:42 -- nvmf/common.sh@295 -- # local -ga net_devs 00:23:34.037 18:11:42 -- nvmf/common.sh@296 -- # e810=() 00:23:34.037 18:11:42 -- nvmf/common.sh@296 -- # local -ga e810 00:23:34.037 18:11:42 -- nvmf/common.sh@297 -- # x722=() 00:23:34.037 18:11:42 -- nvmf/common.sh@297 -- # local -ga x722 00:23:34.037 18:11:42 -- nvmf/common.sh@298 -- # mlx=() 00:23:34.037 18:11:42 -- nvmf/common.sh@298 -- # local -ga mlx 00:23:34.037 18:11:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@302 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@304 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@306 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@308 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@310 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@312 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@315 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@318 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:34.037 18:11:42 -- nvmf/common.sh@320 -- # pci_devs+=("${e810[@]}") 00:23:34.037 18:11:42 -- nvmf/common.sh@321 -- # [[ rdma == rdma ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@322 -- # pci_devs+=("${x722[@]}") 00:23:34.037 18:11:42 -- nvmf/common.sh@323 -- # pci_devs+=("${mlx[@]}") 00:23:34.037 18:11:42 -- nvmf/common.sh@327 -- # [[ mlx5 == mlx5 ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@328 -- # pci_devs=("${mlx[@]}") 00:23:34.037 18:11:42 -- nvmf/common.sh@335 -- # (( 2 == 0 )) 00:23:34.037 18:11:42 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:34.037 18:11:42 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.0 (0x15b3 - 0x1015)' 00:23:34.037 Found 0000:18:00.0 (0x15b3 - 0x1015) 00:23:34.037 18:11:42 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:34.037 18:11:42 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:34.037 18:11:43 -- nvmf/common.sh@340 -- # for pci in "${pci_devs[@]}" 00:23:34.037 18:11:43 -- nvmf/common.sh@341 -- # echo 'Found 0000:18:00.1 (0x15b3 - 0x1015)' 00:23:34.037 Found 0000:18:00.1 (0x15b3 - 0x1015) 00:23:34.037 18:11:43 -- nvmf/common.sh@342 -- # [[ mlx5_core == unknown ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@346 -- # [[ mlx5_core == unbound ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@350 -- # [[ 0x1015 == \0\x\1\0\1\7 ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@351 -- # [[ 0x1015 == \0\x\1\0\1\9 ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@352 -- # [[ rdma == rdma ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@362 -- # NVME_CONNECT='nvme connect -i 15' 00:23:34.037 18:11:43 -- nvmf/common.sh@366 -- # (( 0 > 0 )) 00:23:34.037 18:11:43 -- nvmf/common.sh@372 -- # [[ mlx5 == e810 ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:34.037 18:11:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.037 18:11:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:34.037 18:11:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.037 18:11:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.0: mlx_0_0' 00:23:34.037 Found net devices under 0000:18:00.0: mlx_0_0 00:23:34.037 18:11:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.037 18:11:43 -- nvmf/common.sh@382 -- # for pci in "${pci_devs[@]}" 00:23:34.037 18:11:43 -- nvmf/common.sh@383 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:34.037 18:11:43 -- nvmf/common.sh@384 -- # (( 1 == 0 )) 00:23:34.037 18:11:43 -- nvmf/common.sh@388 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:34.037 18:11:43 -- nvmf/common.sh@389 -- # echo 'Found net devices under 0000:18:00.1: mlx_0_1' 00:23:34.037 Found net devices under 0000:18:00.1: mlx_0_1 00:23:34.037 18:11:43 -- nvmf/common.sh@390 -- # net_devs+=("${pci_net_devs[@]}") 00:23:34.037 18:11:43 -- nvmf/common.sh@393 -- # (( 2 == 0 )) 00:23:34.037 18:11:43 -- nvmf/common.sh@403 -- # is_hw=yes 00:23:34.037 18:11:43 -- nvmf/common.sh@405 -- # [[ yes == yes ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@406 -- # [[ rdma == tcp ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@408 -- # [[ rdma == rdma ]] 00:23:34.037 18:11:43 -- nvmf/common.sh@409 -- # rdma_device_init 00:23:34.037 18:11:43 -- nvmf/common.sh@490 -- # load_ib_rdma_modules 00:23:34.037 18:11:43 -- nvmf/common.sh@58 -- # uname 00:23:34.037 18:11:43 -- nvmf/common.sh@58 -- # '[' Linux '!=' Linux ']' 00:23:34.037 18:11:43 -- nvmf/common.sh@62 -- # modprobe ib_cm 00:23:34.037 18:11:43 -- nvmf/common.sh@63 -- # modprobe ib_core 00:23:34.037 18:11:43 -- nvmf/common.sh@64 -- # modprobe ib_umad 00:23:34.037 18:11:43 -- nvmf/common.sh@65 -- # modprobe ib_uverbs 00:23:34.037 18:11:43 -- nvmf/common.sh@66 -- # modprobe iw_cm 00:23:34.037 18:11:43 -- nvmf/common.sh@67 -- # modprobe rdma_cm 00:23:34.037 18:11:43 -- nvmf/common.sh@68 -- # modprobe rdma_ucm 00:23:34.037 18:11:43 -- nvmf/common.sh@491 -- # allocate_nic_ips 00:23:34.038 18:11:43 -- nvmf/common.sh@72 -- # (( count = NVMF_IP_LEAST_ADDR )) 00:23:34.038 18:11:43 -- nvmf/common.sh@73 -- # get_rdma_if_list 00:23:34.038 18:11:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:34.038 18:11:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:34.038 18:11:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:34.038 18:11:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:34.038 18:11:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:34.038 18:11:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@105 -- # continue 2 00:23:34.038 18:11:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@105 -- # continue 2 00:23:34.038 18:11:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:34.038 18:11:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:34.038 18:11:43 -- nvmf/common.sh@74 -- # ip=192.168.100.8 00:23:34.038 18:11:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.8 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_0 00:23:34.038 16: mlx_0_0: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:34.038 link/ether 50:6b:4b:b4:ab:56 brd ff:ff:ff:ff:ff:ff 00:23:34.038 altname enp24s0f0np0 00:23:34.038 altname ens785f0np0 00:23:34.038 inet 192.168.100.8/24 scope global mlx_0_0 00:23:34.038 valid_lft forever preferred_lft forever 00:23:34.038 18:11:43 -- nvmf/common.sh@73 -- # for nic_name in $(get_rdma_if_list) 00:23:34.038 18:11:43 -- nvmf/common.sh@74 -- # get_ip_address mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:34.038 18:11:43 -- nvmf/common.sh@74 -- # ip=192.168.100.9 00:23:34.038 18:11:43 -- nvmf/common.sh@75 -- # [[ -z 192.168.100.9 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@81 -- # ip addr show mlx_0_1 00:23:34.038 17: mlx_0_1: mtu 1500 qdisc mq state DOWN group default qlen 1000 00:23:34.038 link/ether 50:6b:4b:b4:ab:57 brd ff:ff:ff:ff:ff:ff 00:23:34.038 altname enp24s0f1np1 00:23:34.038 altname ens785f1np1 00:23:34.038 inet 192.168.100.9/24 scope global mlx_0_1 00:23:34.038 valid_lft forever preferred_lft forever 00:23:34.038 18:11:43 -- nvmf/common.sh@411 -- # return 0 00:23:34.038 18:11:43 -- nvmf/common.sh@439 -- # '[' '' == iso ']' 00:23:34.038 18:11:43 -- nvmf/common.sh@443 -- # NVMF_TRANSPORT_OPTS='-t rdma' 00:23:34.038 18:11:43 -- nvmf/common.sh@444 -- # [[ rdma == \r\d\m\a ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@445 -- # get_available_rdma_ips 00:23:34.038 18:11:43 -- nvmf/common.sh@86 -- # get_rdma_if_list 00:23:34.038 18:11:43 -- nvmf/common.sh@92 -- # local net_dev rxe_net_dev rxe_net_devs 00:23:34.038 18:11:43 -- nvmf/common.sh@94 -- # mapfile -t rxe_net_devs 00:23:34.038 18:11:43 -- nvmf/common.sh@94 -- # rxe_cfg rxe-net 00:23:34.038 18:11:43 -- nvmf/common.sh@54 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/rxe_cfg_small.sh rxe-net 00:23:34.038 18:11:43 -- nvmf/common.sh@96 -- # (( 2 == 0 )) 00:23:34.038 18:11:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_0 == \m\l\x\_\0\_\0 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@104 -- # echo mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@105 -- # continue 2 00:23:34.038 18:11:43 -- nvmf/common.sh@101 -- # for net_dev in "${net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\0 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@102 -- # for rxe_net_dev in "${rxe_net_devs[@]}" 00:23:34.038 18:11:43 -- nvmf/common.sh@103 -- # [[ mlx_0_1 == \m\l\x\_\0\_\1 ]] 00:23:34.038 18:11:43 -- nvmf/common.sh@104 -- # echo mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@105 -- # continue 2 00:23:34.038 18:11:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:34.038 18:11:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@112 -- # interface=mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_0 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:34.038 18:11:43 -- nvmf/common.sh@86 -- # for nic_name in $(get_rdma_if_list) 00:23:34.038 18:11:43 -- nvmf/common.sh@87 -- # get_ip_address mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@112 -- # interface=mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # ip -o -4 addr show mlx_0_1 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # awk '{print $4}' 00:23:34.038 18:11:43 -- nvmf/common.sh@113 -- # cut -d/ -f1 00:23:34.038 18:11:43 -- nvmf/common.sh@445 -- # RDMA_IP_LIST='192.168.100.8 00:23:34.038 192.168.100.9' 00:23:34.038 18:11:43 -- nvmf/common.sh@446 -- # echo '192.168.100.8 00:23:34.038 192.168.100.9' 00:23:34.038 18:11:43 -- nvmf/common.sh@446 -- # head -n 1 00:23:34.038 18:11:43 -- nvmf/common.sh@446 -- # NVMF_FIRST_TARGET_IP=192.168.100.8 00:23:34.038 18:11:43 -- nvmf/common.sh@447 -- # echo '192.168.100.8 00:23:34.038 192.168.100.9' 00:23:34.038 18:11:43 -- nvmf/common.sh@447 -- # tail -n +2 00:23:34.038 18:11:43 -- nvmf/common.sh@447 -- # head -n 1 00:23:34.038 18:11:43 -- nvmf/common.sh@447 -- # NVMF_SECOND_TARGET_IP=192.168.100.9 00:23:34.038 18:11:43 -- nvmf/common.sh@448 -- # '[' -z 192.168.100.8 ']' 00:23:34.038 18:11:43 -- nvmf/common.sh@452 -- # NVMF_TRANSPORT_OPTS='-t rdma --num-shared-buffers 1024' 00:23:34.038 18:11:43 -- nvmf/common.sh@457 -- # '[' rdma == tcp ']' 00:23:34.038 18:11:43 -- nvmf/common.sh@457 -- # '[' rdma == rdma ']' 00:23:34.038 18:11:43 -- nvmf/common.sh@463 -- # modprobe nvme-rdma 00:23:34.296 18:11:43 -- spdkcli/nvmf.sh@24 -- # NVMF_TARGET_IP=192.168.100.8 00:23:34.296 18:11:43 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:23:34.296 18:11:43 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:34.296 18:11:43 -- common/autotest_common.sh@10 -- # set +x 00:23:34.296 18:11:43 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:23:34.296 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:23:34.296 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:23:34.296 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:23:34.296 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:23:34.296 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:23:34.296 '\''nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:23:34.296 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:34.296 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:34.296 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4'\'' '\''192.168.100.8:4260'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4'\'' '\''192.168.100.8:4261'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4'\'' '\''192.168.100.8:4262'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:23:34.296 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:23:34.296 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:23:34.296 ' 00:23:34.555 [2024-04-26 18:11:43.599639] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:37.091 [2024-04-26 18:11:45.718090] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_0(0x88f600/0x8a10b0) succeed. 00:23:37.091 [2024-04-26 18:11:45.729713] rdma.c:2562:create_ib_device: *NOTICE*: Create IB device mlx5_1(0x890ab0/0x8e2740) succeed. 00:23:38.032 [2024-04-26 18:11:46.994737] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4260 *** 00:23:40.568 [2024-04-26 18:11:49.221678] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4261 *** 00:23:42.473 [2024-04-26 18:11:51.147962] rdma.c:3018:nvmf_rdma_listen: *NOTICE*: *** NVMe/RDMA Target Listening on 192.168.100.8 port 4262 *** 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:23:43.852 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:23:43.852 Executing command: ['nvmf/transport create rdma max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:23:43.852 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:43.852 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:43.852 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4260 IPv4', '192.168.100.8:4260', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4261 IPv4', '192.168.100.8:4261', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create rdma 192.168.100.8 4262 IPv4', '192.168.100.8:4262', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:23:43.852 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:23:43.852 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:23:43.852 18:11:52 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:23:43.852 18:11:52 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:43.852 18:11:52 -- common/autotest_common.sh@10 -- # set +x 00:23:43.852 18:11:52 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:23:43.852 18:11:52 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:43.852 18:11:52 -- common/autotest_common.sh@10 -- # set +x 00:23:43.852 18:11:52 -- spdkcli/nvmf.sh@69 -- # check_match 00:23:43.852 18:11:52 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:23:44.111 18:11:53 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:23:44.111 18:11:53 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:23:44.111 18:11:53 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:23:44.111 18:11:53 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:44.111 18:11:53 -- common/autotest_common.sh@10 -- # set +x 00:23:44.111 18:11:53 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:23:44.111 18:11:53 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:44.111 18:11:53 -- common/autotest_common.sh@10 -- # set +x 00:23:44.111 18:11:53 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:23:44.111 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:23:44.111 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:23:44.111 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:23:44.111 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262'\'' '\''192.168.100.8:4262'\'' 00:23:44.111 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''192.168.100.8:4261'\'' 00:23:44.111 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:23:44.111 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:23:44.111 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:23:44.111 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:23:44.111 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:23:44.111 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:23:44.111 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:23:44.112 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:23:44.112 ' 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete rdma 192.168.100.8 4262', '192.168.100.8:4262', False] 00:23:49.384 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '192.168.100.8:4261', False] 00:23:49.384 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:23:49.384 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:23:49.384 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:23:49.384 18:11:58 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:23:49.384 18:11:58 -- common/autotest_common.sh@726 -- # xtrace_disable 00:23:49.384 18:11:58 -- common/autotest_common.sh@10 -- # set +x 00:23:49.384 18:11:58 -- spdkcli/nvmf.sh@90 -- # killprocess 1064777 00:23:49.384 18:11:58 -- common/autotest_common.sh@946 -- # '[' -z 1064777 ']' 00:23:49.384 18:11:58 -- common/autotest_common.sh@950 -- # kill -0 1064777 00:23:49.384 18:11:58 -- common/autotest_common.sh@951 -- # uname 00:23:49.384 18:11:58 -- common/autotest_common.sh@951 -- # '[' Linux = Linux ']' 00:23:49.384 18:11:58 -- common/autotest_common.sh@952 -- # ps --no-headers -o comm= 1064777 00:23:49.384 18:11:58 -- common/autotest_common.sh@952 -- # process_name=reactor_0 00:23:49.384 18:11:58 -- common/autotest_common.sh@956 -- # '[' reactor_0 = sudo ']' 00:23:49.384 18:11:58 -- common/autotest_common.sh@964 -- # echo 'killing process with pid 1064777' 00:23:49.384 killing process with pid 1064777 00:23:49.384 18:11:58 -- common/autotest_common.sh@965 -- # kill 1064777 00:23:49.384 [2024-04-26 18:11:58.377311] app.c: 937:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:49.384 18:11:58 -- common/autotest_common.sh@970 -- # wait 1064777 00:23:49.384 [2024-04-26 18:11:58.430354] rdma.c:2871:nvmf_rdma_destroy: *ERROR*: transport wr pool count is 4095 but should be 2048 00:23:49.643 18:11:58 -- spdkcli/nvmf.sh@1 -- # nvmftestfini 00:23:49.643 18:11:58 -- nvmf/common.sh@477 -- # nvmfcleanup 00:23:49.643 18:11:58 -- nvmf/common.sh@117 -- # sync 00:23:49.643 18:11:58 -- nvmf/common.sh@119 -- # '[' rdma == tcp ']' 00:23:49.643 18:11:58 -- nvmf/common.sh@119 -- # '[' rdma == rdma ']' 00:23:49.643 18:11:58 -- nvmf/common.sh@120 -- # set +e 00:23:49.643 18:11:58 -- nvmf/common.sh@121 -- # for i in {1..20} 00:23:49.643 18:11:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-rdma 00:23:49.643 rmmod nvme_rdma 00:23:49.643 rmmod nvme_fabrics 00:23:49.643 18:11:58 -- nvmf/common.sh@123 -- # modprobe -v -r nvme-fabrics 00:23:49.643 18:11:58 -- nvmf/common.sh@124 -- # set -e 00:23:49.643 18:11:58 -- nvmf/common.sh@125 -- # return 0 00:23:49.643 18:11:58 -- nvmf/common.sh@478 -- # '[' -n '' ']' 00:23:49.643 18:11:58 -- nvmf/common.sh@481 -- # '[' '' == iso ']' 00:23:49.643 18:11:58 -- nvmf/common.sh@484 -- # [[ rdma == \t\c\p ]] 00:23:49.643 00:23:49.643 real 0m23.126s 00:23:49.643 user 0m49.449s 00:23:49.643 sys 0m5.887s 00:23:49.643 18:11:58 -- common/autotest_common.sh@1122 -- # xtrace_disable 00:23:49.643 18:11:58 -- common/autotest_common.sh@10 -- # set +x 00:23:49.643 ************************************ 00:23:49.643 END TEST spdkcli_nvmf_rdma 00:23:49.643 ************************************ 00:23:49.643 18:11:58 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@310 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@314 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@319 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@328 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@341 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@345 -- # '[' 0 -eq 1 ']' 00:23:49.643 18:11:58 -- spdk/autotest.sh@350 -- # '[' 0 -eq 1 ']' 00:23:49.644 18:11:58 -- spdk/autotest.sh@354 -- # '[' 0 -eq 1 ']' 00:23:49.644 18:11:58 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:23:49.644 18:11:58 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:23:49.644 18:11:58 -- spdk/autotest.sh@369 -- # [[ 0 -eq 1 ]] 00:23:49.644 18:11:58 -- spdk/autotest.sh@373 -- # [[ 0 -eq 1 ]] 00:23:49.644 18:11:58 -- spdk/autotest.sh@378 -- # trap - SIGINT SIGTERM EXIT 00:23:49.644 18:11:58 -- spdk/autotest.sh@380 -- # timing_enter post_cleanup 00:23:49.644 18:11:58 -- common/autotest_common.sh@720 -- # xtrace_disable 00:23:49.644 18:11:58 -- common/autotest_common.sh@10 -- # set +x 00:23:49.644 18:11:58 -- spdk/autotest.sh@381 -- # autotest_cleanup 00:23:49.644 18:11:58 -- common/autotest_common.sh@1388 -- # local autotest_es=0 00:23:49.644 18:11:58 -- common/autotest_common.sh@1389 -- # xtrace_disable 00:23:49.644 18:11:58 -- common/autotest_common.sh@10 -- # set +x 00:23:53.868 INFO: APP EXITING 00:23:53.868 INFO: killing all VMs 00:23:53.868 INFO: killing vhost app 00:23:53.868 INFO: EXIT DONE 00:23:56.403 Waiting for block devices as requested 00:23:56.662 0000:5f:00.0 (8086 0a54): vfio-pci -> nvme 00:23:56.662 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:56.921 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:56.921 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:56.921 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:57.179 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:57.179 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:57.179 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:57.179 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:23:57.439 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:23:57.439 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:23:57.439 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:23:57.698 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:23:57.698 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:23:57.698 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:23:57.956 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:23:57.956 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:24:01.244 Cleaning 00:24:01.244 Removing: /var/run/dpdk/spdk0/config 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:24:01.244 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:24:01.244 Removing: /var/run/dpdk/spdk0/hugepage_info 00:24:01.244 Removing: /var/run/dpdk/spdk1/config 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:24:01.244 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:24:01.244 Removing: /var/run/dpdk/spdk1/hugepage_info 00:24:01.244 Removing: /var/run/dpdk/spdk1/mp_socket 00:24:01.244 Removing: /var/run/dpdk/spdk2/config 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:24:01.244 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:24:01.244 Removing: /var/run/dpdk/spdk2/hugepage_info 00:24:01.244 Removing: /var/run/dpdk/spdk3/config 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:24:01.244 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:24:01.244 Removing: /var/run/dpdk/spdk3/hugepage_info 00:24:01.244 Removing: /var/run/dpdk/spdk4/config 00:24:01.244 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:24:01.244 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:24:01.244 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:24:01.244 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:24:01.503 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:24:01.503 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:24:01.503 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:24:01.503 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:24:01.503 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:24:01.503 Removing: /var/run/dpdk/spdk4/hugepage_info 00:24:01.503 Removing: /dev/shm/bdevperf_trace.pid1001572 00:24:01.503 Removing: /dev/shm/bdevperf_trace.pid920607 00:24:01.503 Removing: /dev/shm/bdev_svc_trace.1 00:24:01.503 Removing: /dev/shm/nvmf_trace.0 00:24:01.503 Removing: /dev/shm/spdk_tgt_trace.pid823938 00:24:01.503 Removing: /var/run/dpdk/spdk0 00:24:01.503 Removing: /var/run/dpdk/spdk1 00:24:01.503 Removing: /var/run/dpdk/spdk2 00:24:01.503 Removing: /var/run/dpdk/spdk3 00:24:01.503 Removing: /var/run/dpdk/spdk4 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1000662 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1001572 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1005338 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1011493 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1012263 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1012972 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1013727 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1013932 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1017841 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1017919 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1021700 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1022148 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1022526 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1023170 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1023237 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1027272 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1027729 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1031450 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1034132 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1040144 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1040149 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1056042 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1056337 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1061282 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1061692 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1063195 00:24:01.503 Removing: /var/run/dpdk/spdk_pid1064777 00:24:01.503 Removing: /var/run/dpdk/spdk_pid821299 00:24:01.503 Removing: /var/run/dpdk/spdk_pid822497 00:24:01.503 Removing: /var/run/dpdk/spdk_pid823938 00:24:01.503 Removing: /var/run/dpdk/spdk_pid824526 00:24:01.503 Removing: /var/run/dpdk/spdk_pid825296 00:24:01.503 Removing: /var/run/dpdk/spdk_pid825484 00:24:01.503 Removing: /var/run/dpdk/spdk_pid826424 00:24:01.503 Removing: /var/run/dpdk/spdk_pid826472 00:24:01.503 Removing: /var/run/dpdk/spdk_pid826774 00:24:01.503 Removing: /var/run/dpdk/spdk_pid831193 00:24:01.503 Removing: /var/run/dpdk/spdk_pid832592 00:24:01.762 Removing: /var/run/dpdk/spdk_pid832838 00:24:01.762 Removing: /var/run/dpdk/spdk_pid833190 00:24:01.762 Removing: /var/run/dpdk/spdk_pid833519 00:24:01.762 Removing: /var/run/dpdk/spdk_pid833776 00:24:01.762 Removing: /var/run/dpdk/spdk_pid833994 00:24:01.762 Removing: /var/run/dpdk/spdk_pid834198 00:24:01.762 Removing: /var/run/dpdk/spdk_pid834512 00:24:01.762 Removing: /var/run/dpdk/spdk_pid835619 00:24:01.762 Removing: /var/run/dpdk/spdk_pid838323 00:24:01.762 Removing: /var/run/dpdk/spdk_pid838555 00:24:01.762 Removing: /var/run/dpdk/spdk_pid838863 00:24:01.762 Removing: /var/run/dpdk/spdk_pid838960 00:24:01.762 Removing: /var/run/dpdk/spdk_pid839531 00:24:01.762 Removing: /var/run/dpdk/spdk_pid839549 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840132 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840201 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840533 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840559 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840773 00:24:01.762 Removing: /var/run/dpdk/spdk_pid840956 00:24:01.762 Removing: /var/run/dpdk/spdk_pid841431 00:24:01.762 Removing: /var/run/dpdk/spdk_pid841641 00:24:01.762 Removing: /var/run/dpdk/spdk_pid841893 00:24:01.762 Removing: /var/run/dpdk/spdk_pid842130 00:24:01.762 Removing: /var/run/dpdk/spdk_pid842327 00:24:01.762 Removing: /var/run/dpdk/spdk_pid842477 00:24:01.762 Removing: /var/run/dpdk/spdk_pid842793 00:24:01.762 Removing: /var/run/dpdk/spdk_pid843002 00:24:01.762 Removing: /var/run/dpdk/spdk_pid843220 00:24:01.762 Removing: /var/run/dpdk/spdk_pid843424 00:24:01.762 Removing: /var/run/dpdk/spdk_pid843642 00:24:01.762 Removing: /var/run/dpdk/spdk_pid843887 00:24:01.762 Removing: /var/run/dpdk/spdk_pid844215 00:24:01.762 Removing: /var/run/dpdk/spdk_pid844432 00:24:01.762 Removing: /var/run/dpdk/spdk_pid844649 00:24:01.762 Removing: /var/run/dpdk/spdk_pid844861 00:24:01.762 Removing: /var/run/dpdk/spdk_pid845068 00:24:01.762 Removing: /var/run/dpdk/spdk_pid845309 00:24:01.762 Removing: /var/run/dpdk/spdk_pid845625 00:24:01.762 Removing: /var/run/dpdk/spdk_pid845865 00:24:01.762 Removing: /var/run/dpdk/spdk_pid846071 00:24:01.762 Removing: /var/run/dpdk/spdk_pid846289 00:24:01.762 Removing: /var/run/dpdk/spdk_pid846496 00:24:01.762 Removing: /var/run/dpdk/spdk_pid846754 00:24:01.762 Removing: /var/run/dpdk/spdk_pid847087 00:24:01.762 Removing: /var/run/dpdk/spdk_pid847300 00:24:01.762 Removing: /var/run/dpdk/spdk_pid847429 00:24:01.762 Removing: /var/run/dpdk/spdk_pid847826 00:24:01.762 Removing: /var/run/dpdk/spdk_pid851270 00:24:01.762 Removing: /var/run/dpdk/spdk_pid888142 00:24:01.762 Removing: /var/run/dpdk/spdk_pid891649 00:24:01.762 Removing: /var/run/dpdk/spdk_pid899111 00:24:01.762 Removing: /var/run/dpdk/spdk_pid903645 00:24:01.762 Removing: /var/run/dpdk/spdk_pid906822 00:24:01.762 Removing: /var/run/dpdk/spdk_pid907474 00:24:01.762 Removing: /var/run/dpdk/spdk_pid920607 00:24:02.021 Removing: /var/run/dpdk/spdk_pid920815 00:24:02.021 Removing: /var/run/dpdk/spdk_pid924314 00:24:02.021 Removing: /var/run/dpdk/spdk_pid929275 00:24:02.021 Removing: /var/run/dpdk/spdk_pid931363 00:24:02.021 Removing: /var/run/dpdk/spdk_pid940038 00:24:02.021 Removing: /var/run/dpdk/spdk_pid960711 00:24:02.021 Removing: /var/run/dpdk/spdk_pid964055 00:24:02.021 Removing: /var/run/dpdk/spdk_pid977005 00:24:02.021 Removing: /var/run/dpdk/spdk_pid999779 00:24:02.021 Clean 00:24:02.021 18:12:11 -- common/autotest_common.sh@1447 -- # return 0 00:24:02.021 18:12:11 -- spdk/autotest.sh@382 -- # timing_exit post_cleanup 00:24:02.021 18:12:11 -- common/autotest_common.sh@726 -- # xtrace_disable 00:24:02.021 18:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:02.280 18:12:11 -- spdk/autotest.sh@384 -- # timing_exit autotest 00:24:02.280 18:12:11 -- common/autotest_common.sh@726 -- # xtrace_disable 00:24:02.280 18:12:11 -- common/autotest_common.sh@10 -- # set +x 00:24:02.280 18:12:11 -- spdk/autotest.sh@385 -- # chmod a+r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:24:02.280 18:12:11 -- spdk/autotest.sh@387 -- # [[ -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log ]] 00:24:02.280 18:12:11 -- spdk/autotest.sh@387 -- # rm -f /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/udev.log 00:24:02.280 18:12:11 -- spdk/autotest.sh@389 -- # hash lcov 00:24:02.280 18:12:11 -- spdk/autotest.sh@389 -- # [[ CC_TYPE=gcc == *\c\l\a\n\g* ]] 00:24:02.280 18:12:11 -- spdk/autotest.sh@391 -- # hostname 00:24:02.280 18:12:11 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -c -d /var/jenkins/workspace/nvmf-phy-autotest/spdk -t spdk-wfp-34 -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info 00:24:02.280 geninfo: WARNING: invalid characters removed from testname! 00:24:24.214 18:12:29 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:24.214 18:12:32 -- spdk/autotest.sh@393 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:24.779 18:12:33 -- spdk/autotest.sh@394 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '/usr/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:26.677 18:12:35 -- spdk/autotest.sh@395 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:28.051 18:12:37 -- spdk/autotest.sh@396 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:29.953 18:12:38 -- spdk/autotest.sh@397 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --no-external -q -r /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/cov_total.info 00:24:31.327 18:12:40 -- spdk/autotest.sh@398 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:24:31.586 18:12:40 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/common.sh 00:24:31.586 18:12:40 -- scripts/common.sh@508 -- $ [[ -e /bin/wpdk_common.sh ]] 00:24:31.586 18:12:40 -- scripts/common.sh@516 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:31.586 18:12:40 -- scripts/common.sh@517 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:31.586 18:12:40 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.586 18:12:40 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.586 18:12:40 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.586 18:12:40 -- paths/export.sh@5 -- $ export PATH 00:24:31.586 18:12:40 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:31.586 18:12:40 -- common/autobuild_common.sh@434 -- $ out=/var/jenkins/workspace/nvmf-phy-autotest/spdk/../output 00:24:31.586 18:12:40 -- common/autobuild_common.sh@435 -- $ date +%s 00:24:31.586 18:12:40 -- common/autobuild_common.sh@435 -- $ mktemp -dt spdk_1714147960.XXXXXX 00:24:31.586 18:12:40 -- common/autobuild_common.sh@435 -- $ SPDK_WORKSPACE=/tmp/spdk_1714147960.eZnwJx 00:24:31.586 18:12:40 -- common/autobuild_common.sh@437 -- $ [[ -n '' ]] 00:24:31.586 18:12:40 -- common/autobuild_common.sh@441 -- $ '[' -n '' ']' 00:24:31.586 18:12:40 -- common/autobuild_common.sh@444 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/' 00:24:31.586 18:12:40 -- common/autobuild_common.sh@448 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp' 00:24:31.587 18:12:40 -- common/autobuild_common.sh@450 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:24:31.587 18:12:40 -- common/autobuild_common.sh@451 -- $ get_config_params 00:24:31.587 18:12:40 -- common/autotest_common.sh@395 -- $ xtrace_disable 00:24:31.587 18:12:40 -- common/autotest_common.sh@10 -- $ set +x 00:24:31.587 18:12:40 -- common/autobuild_common.sh@451 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:24:31.587 18:12:40 -- common/autobuild_common.sh@453 -- $ start_monitor_resources 00:24:31.587 18:12:40 -- pm/common@17 -- $ local monitor 00:24:31.587 18:12:40 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:31.587 18:12:40 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1078037 00:24:31.587 18:12:40 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:31.587 18:12:40 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1078039 00:24:31.587 18:12:40 -- pm/common@21 -- $ date +%s 00:24:31.587 18:12:40 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:31.587 18:12:40 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1078042 00:24:31.587 18:12:40 -- pm/common@21 -- $ date +%s 00:24:31.587 18:12:40 -- pm/common@19 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:31.587 18:12:40 -- pm/common@23 -- $ MONITOR_RESOURCES_PIDS["$monitor"]=1078045 00:24:31.587 18:12:40 -- pm/common@26 -- $ sleep 1 00:24:31.587 18:12:40 -- pm/common@21 -- $ date +%s 00:24:31.587 18:12:40 -- pm/common@21 -- $ date +%s 00:24:31.587 18:12:40 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714147960 00:24:31.587 18:12:40 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714147960 00:24:31.587 18:12:40 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714147960 00:24:31.587 18:12:40 -- pm/common@21 -- $ sudo -E /var/jenkins/workspace/nvmf-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power -l -p monitor.autopackage.sh.1714147960 00:24:31.587 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714147960_collect-bmc-pm.bmc.pm.log 00:24:31.587 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714147960_collect-vmstat.pm.log 00:24:31.587 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714147960_collect-cpu-load.pm.log 00:24:31.587 Redirecting to /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/monitor.autopackage.sh.1714147960_collect-cpu-temp.pm.log 00:24:32.621 18:12:41 -- common/autobuild_common.sh@454 -- $ trap stop_monitor_resources EXIT 00:24:32.621 18:12:41 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j72 00:24:32.621 18:12:41 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:32.621 18:12:41 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:24:32.621 18:12:41 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:24:32.621 18:12:41 -- spdk/autopackage.sh@19 -- $ timing_finish 00:24:32.621 18:12:41 -- common/autotest_common.sh@732 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:24:32.621 18:12:41 -- common/autotest_common.sh@733 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:24:32.621 18:12:41 -- common/autotest_common.sh@735 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/timing.txt 00:24:32.621 18:12:41 -- spdk/autopackage.sh@20 -- $ exit 0 00:24:32.621 18:12:41 -- spdk/autopackage.sh@1 -- $ stop_monitor_resources 00:24:32.621 18:12:41 -- pm/common@30 -- $ signal_monitor_resources TERM 00:24:32.621 18:12:41 -- pm/common@41 -- $ local monitor pid pids signal=TERM 00:24:32.621 18:12:41 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:32.621 18:12:41 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-load.pid ]] 00:24:32.621 18:12:41 -- pm/common@45 -- $ pid=1078059 00:24:32.621 18:12:41 -- pm/common@52 -- $ sudo kill -TERM 1078059 00:24:32.621 18:12:41 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:32.621 18:12:41 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-vmstat.pid ]] 00:24:32.621 18:12:41 -- pm/common@45 -- $ pid=1078058 00:24:32.621 18:12:41 -- pm/common@52 -- $ sudo kill -TERM 1078058 00:24:32.621 18:12:41 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:32.621 18:12:41 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-cpu-temp.pid ]] 00:24:32.621 18:12:41 -- pm/common@45 -- $ pid=1078061 00:24:32.621 18:12:41 -- pm/common@52 -- $ sudo kill -TERM 1078061 00:24:32.621 18:12:41 -- pm/common@43 -- $ for monitor in "${MONITOR_RESOURCES[@]}" 00:24:32.621 18:12:41 -- pm/common@44 -- $ [[ -e /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/collect-bmc-pm.pid ]] 00:24:32.621 18:12:41 -- pm/common@45 -- $ pid=1078060 00:24:32.621 18:12:41 -- pm/common@52 -- $ sudo kill -TERM 1078060 00:24:32.622 + [[ -n 723969 ]] 00:24:32.622 + sudo kill 723969 00:24:32.631 [Pipeline] } 00:24:32.647 [Pipeline] // stage 00:24:32.651 [Pipeline] } 00:24:32.666 [Pipeline] // timeout 00:24:32.669 [Pipeline] } 00:24:32.684 [Pipeline] // catchError 00:24:32.687 [Pipeline] } 00:24:32.702 [Pipeline] // wrap 00:24:32.708 [Pipeline] } 00:24:32.722 [Pipeline] // catchError 00:24:32.729 [Pipeline] stage 00:24:32.731 [Pipeline] { (Epilogue) 00:24:32.739 [Pipeline] catchError 00:24:32.740 [Pipeline] { 00:24:32.749 [Pipeline] echo 00:24:32.750 Cleanup processes 00:24:32.753 [Pipeline] sh 00:24:33.033 + sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:33.033 1078151 /usr/bin/ipmitool sdr dump /var/jenkins/workspace/nvmf-phy-autotest/spdk/../output/power/sdr.cache 00:24:33.033 1078393 sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:33.046 [Pipeline] sh 00:24:33.327 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-phy-autotest/spdk 00:24:33.327 ++ awk '{print $1}' 00:24:33.327 ++ grep -v 'sudo pgrep' 00:24:33.327 + sudo kill -9 1078151 00:24:33.340 [Pipeline] sh 00:24:33.624 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:24:40.197 [Pipeline] sh 00:24:40.482 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:24:40.482 Artifacts sizes are good 00:24:40.499 [Pipeline] archiveArtifacts 00:24:40.507 Archiving artifacts 00:24:40.621 [Pipeline] sh 00:24:40.916 + sudo chown -R sys_sgci /var/jenkins/workspace/nvmf-phy-autotest 00:24:40.930 [Pipeline] cleanWs 00:24:40.939 [WS-CLEANUP] Deleting project workspace... 00:24:40.939 [WS-CLEANUP] Deferred wipeout is used... 00:24:40.945 [WS-CLEANUP] done 00:24:40.947 [Pipeline] } 00:24:40.967 [Pipeline] // catchError 00:24:40.981 [Pipeline] sh 00:24:41.266 + logger -p user.info -t JENKINS-CI 00:24:41.276 [Pipeline] } 00:24:41.293 [Pipeline] // stage 00:24:41.299 [Pipeline] } 00:24:41.317 [Pipeline] // node 00:24:41.323 [Pipeline] End of Pipeline 00:24:41.364 Finished: SUCCESS